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CHAPTER  I 


INTRODUCTION 

In  an  era  of  ever-increasing  emphasis  on  resource 
constraints,  we  must  make  our  choices  carefully.  It  becomes 
extremely  important  to  establish  both  an  efficient,  and  an 
effective  means  of  scheduling  patient  appointments  in  ambulatory 
health  care  services.  This  problem  is  addressed  in  Air  Force 
Regulation  168-4,  which  provides  appointment  system  guidance  to 
Air  Force  executive  managers.  The  regulation  states  that  "each 
medical  treatment  facility  (MTF)  must  have  an  appointment  system 
which  is  responsive  to  the  health  care  needs  of  the  people  using 
the  facility. "  The  exact  appointment  system  configuration 
(centralized  or  decentralized)  is  commander-determined,  but  the 
actual  manpower  earned  for  appointment  services  is  based  on  a 
central  appointment  system.  This  is  formally  known  as  the 
Ambulatory  Care  Administrative  Services  Air  Force  Manpower 
Standard  (AFMS  5142).  The  guiding  directive  also  states  that  "a 
central  appointment  system. ...  has  been  found  to  require  less 
resources  than  a  decentralized  system. "  However,  the  regulation 
goes  on  to  add  that  "facilities  with  an  automated  patient 
appointment  and  scheduling  system  meiy  want  to  consider  a 
combination  of  centralized  or  decentralized  service"  (AFR  168-4 
1987,  6-1). 

The  purpose  of  this  study  is  to  evaluate  the  alternatives 

of : 

(1)  refining  the  existing  appointment  system  configuration 

to  more  adequately  meet  the  staff  needs  while  continuing  to 
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meet  the  needs  of  the  patients,  or; 

(2)  converting  the  existing  system  to  a  combination  of 
centralized  and  decentralized  modes. 

Even  though  consideration  will  be  given  to  the  needs  of  the 
patient  population,  the  major  decision  factors  will  include 
staff  desires,  and  cost. 


Background 

The  USAF  Academy  Hospital,  together  with  the  Cadet  Clinic, 
provide  health  care  services  to  over  14,000  Air  Force  active 
duty  personnel  (includes  4,492  Academy  cadets),  dependents,  and 
civilian  employees.  In  addition,  care  is  provided  to  over 
41,000  retirees  and  their  dependents  in  the  Colorado  Springs 
area  (MAMS  1987,  14-15).  The  facility  is  capable  of  supporting 
105  inpatient  beds,  although  it  is  currently  authorized  to 
operate  as  a  70  bed  hospital  with  a  daily  occupied  bed  census  of 
approximately  60  (MAMS  1987,  13). 

General  tuiJ  specialized  medical  support,  both  inpatient  and 
outpatient,  is  provided  not  only  to  personnel  assigned  to  the 
USAF  Academy,  but  also  to  the  Headquarters,  North  American 
Aerospace  Defense  Command  (NORAD),  United  States  Spates  Command, 
USAF  Space  Command  (including  Peterson  Air  Force  Base  and  Falcon 
Air  Force  Station),  Fort  Carson,  and  retirees  and  their 
dependents  in  the  Colorado  Springs  area. 

The  hospital  provides  such  services  as  Adolescent  Medicine, 


Aerospace  Medicine,  Anesthesiology,  Cardiology,  Dermatology, 
Emergency  Services,  Environmental  Health  Services,  Family 
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Practice,  Gastroenterology,  Gynecology,  General  Surgery, 

Internal  Medicine,  Mental  Health,  Neurology,  Obstetrics, 
Ophthalmology,  Orthopedics,  Otolaryngology,  Pathology,  Sports 
Medicine,  Podiatry  and  Urology.  In  addition,  services  are 
provided  in  Clinical  Psychology,  Dietetics,  Optometry,  Pharmacy, 
Physical  Therapy,  and  Psychiatric  Social  Work.  A  Clinical 
Laboratory,  Radioisotope  Laboratory,  Computerized  Axial 
Tommography  (CAT)  Scanner,  Cardiopulmonary  Laboratory  and  the 
Cadet  Clinic  are  also  an  integral  part  of  the  hospital 
operations.  Dental  Services  are  provided  in  General  Dentistry, 
Oral  Surgery,  Periodontics,  Prosthodont ics,  Endodontics,  and 
Orthodontics  (MHR  1987,  4-5).  The  hospital  also  continues  to 
provide  medical  support  to  the  Cadet  Wing  in  the  areas  of 
intercollegiate,  intramural,  and  physicial  education  athletic 
programs,  and  the  cadet  flying,  soaring,  and  precision 
parachuting  programs  (MHR  1987,  4). 

Development  of  the  Problem 

With  over  260,000  annual  outpatient  visits  in  a  70  bed 
hOiipital  staffed  by  560  personnel  (MAMS  1987,  13,  18,  54), 

arranging  for  the  right  patient  to  see  the  right  provider  at  the 
right  time  for  the  right  amount  of  time  is  a  challenge  for  any 
outpatient  appointment  system. 

The  USAF  Academy  Hospital  evolved  initially  from  using  a 


decentralized  mode  of  appointing  outpatients  in  1961,  to  a 
central  appointment  system  (CAS)  mode  of  operation  by  1966. 
Patient  appointments  were  made  manually  by  the  appointment 


D.  Shields  4 


clerks  using  a  rotary  wheel  file.  Schedules  were  forwarded  to 
outpatien!,  records  to  pull  the  patient  record  prior  to  the 
clinic  visit.  The  system  continued  to  evolve  over  the  years  as 
a  combination  of  a  central ized -decentral ized  system  based  upon 
the  needs  of  the  patients,  the  desires  of  the  staff,  and  the 
direction  of  executive  management. 

Although  the  USAF  Academy  Hospital  appointment  system  is 
primarily  a  centralized  system,  the  CAS  does  not  book  acute 
appointments,  and  there  are  some  clinics  and  ancillary  services 
that  exclusively  book  their  own  appointments.  These  areas 
include:  Urology,  Acute  Care,  Orthopedics/Podiatry,  Nuclear 

Medicine,  Cardiopulmonary,  Physical  Therapy,  Allergy,  Emergency 
Room,  and  the  Cadet  Clinic. 

These  clinics  (except  for  the  Emergency  Room,  Cadet  Clinic, 
Physical  Therapy,  and  Allergy)  all  operate  on  the  Automated 
Quality  of  Care  Evaluation  Support  System  (AQCESS)  automated 
appointment  system.  They  accounted  for  approximately  19  percent 
of  the  total  hospital  appointment  workload  transactions  during 
August  and  September  1987.  The  remaining  81  percent  of  the 
appointment  transactions  are  booked  by  a  combination  of  CAS  and 
clinic  personnel  (appendix  B  &  C).  The  four  areas  mentioned 
above  (in  parentheses)  are  walk-in  type  clinics/ancillary 
services  or  have  unique  scheduling  needs  that  cannot  be 
accommodated  in  the  automated  system. 

The  CAS  has  a  total  of  five  persons  assigned  (four  are  GS-4, 
and  the  supervisor  is  a  GS-5)  representing  a  total  of  47  years 
of  appointment  system  experience.  It  is  interesting  to  note 
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that,  around  19' d,  a  nurse  (RN)  was  hired  as  the  CAS  supervisor. 
It  was  felt  that  this  would  provide  the  necessary  skills  in  the 
CAS  area  to  accomplish  patient  appointment  screening  for 
severity  of  illness.  This  experiment  worked  well  when  a  nurse 
was  present,  but  the  position  was  often  vacant  due  to  the 
inability  to  hire  and  retain  a  nurse  supervisor  at  a  GS-5 
salary.  A  senior  administrative  appointment  clerk  was  then 
hired  to  fill  the  supervisor  role  and  employee  turnover  in  this 
position  was  reduced  (Malone.  1987). 

The  appointment  system  operated  basically  unchanged  until  an 
automated  appointment  system  was  developed  and  installed  in 
February  1985.  The  government  procured  system  was  unique  to  the 
a  USAF  Academy.  CAS  clerks  still  refer  to  this  old  system  as 
extremely  cumbersome.  This  older  system  was  replaced,  in  June 
1987,  by  the  Tri-Service  Medical  Information  System  (TRIMIS) 
AQCESS  Patient  Appointment  System  (PAS). 

The  AQCESS  Appointment  and  Scheduling  Module  (A&SM) 
automated  the  patient  appointment  procedures  in  outpatient 
clinics.  It  was  designed  to  streamline  booking  and  scheduling 
procedures.  The  majority  of  the  clerical  and  management 
appointment  data  used  in  this  Graduate  Research  Project  (GRP) 
was  obtained  from  the  AQCESS  system. 

The  USAF  Academy  Hospital  CAS,  which  is  evaluated  annually, 
has  not  been  a  source  of  patient  complaints  ( Schuknecht  1986  and 
1987).  The  main  problems  surfaced  were  frequent  appointment 
clerk  turnover  (three  CAS  clerks  oup  of  five  within  the  last 
year)  and  the  demand  for  appointments  far  exceeding  the  queuitity 
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of  available  CAS  appointments.  The  report  also  pointed  out  that 
although  demand  was  high,  there  were  unfilled  appointments  which 
were  usually  the  result  of  providers  alloting  appointment  times 
that  only  they  or  clinic  personnel  could  schedule  (Schuknecht, 
1987). 

On  August  5,  1987,  the  Director  of  Patient  Affairs,  and  the 
Nursing  Supervisor  for  Ambulatory  Care  Services  completed  a 
three  page  study  of  decentralizing  the  appointment  system  (see 
appendix  F).  They  concluded  that  no  changes  should  be  made  to 
the  current  appointment  system  (Pollard  and  Atkins,  1987). 

The  USAF  Hospital  executive  management  has  discussed  the 
centralized -decentralized  issue  many  times  at  executive 
management  meetings.  A  strong  desire  existed  to  analyze  the 
appointment  system  workload  and  the  attitudes  of  the 
professional  staff  (CAS,  Clinics,  Information  Systems,  Executive 
Management)  to  determine  if  decentralizing  a  portion  or  all  of 
the  CAS  would  improve  clinic  auiministration.  It  was  felt  that, 
although  patient  satisfaction  is  critical  to  an  efficient  PAS, 
most  patients  are  unknowledgeable  about  a  decentralized  system 
due  to  the  highly  centralized  configuration  at  the  USAF  Academy 
Hospital.  A  comprehensive  patient  satisfaction  survey  would  be 
of  li-Dcle  benefit  until  after  a  more  decentralized  system  is 
implementc  . 
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Statement  of  the  Problem 

To  develop  a  centralized  or  decentralized  appointment  scheduling 
system  configuration  for  outpatients  at  the  United  States  Air 
Force  Academy  Hospital . 

Research  Objectives 

The  research  objectives  of  this  study  were  to: 

1.  Review  the  Fiscal  Year  (FY)  1987  workload  at  the  USAF 
Academy  Hospital  to  determine  workload  demands  in  clinical 
areas . 

2.  Review  a  minimum  of  15  percent  of  the  annual  appointment 
transaction  data  (a  total  of  two  months  data)  to  determine 
clinic,  clerk,  and  central  appointments  personnel  workload. 

3.  Determine  the  outpatient  satisfaction  levels  with  the 
present  appointment  system  using  the  1987  Air  Force  Health 
Care  Survey  (appendix  H). 

4.  Develop  a  suitable  and  structured  staff  interview 
questionnaire  for  use  as  the  research  survey  instrument. 

5.  Conduct  a  pre-test  of  the  staff  survey  questionnaire  to 
establish  the  validity  of  the  survey  instrument. 

6.  Determine  alternate  methods  of  providing  appointment 
services  (centralized  or  decentralized)  and  evaluate  the 
alternatives  using  cost  effectiveness  analysis  (CEA) 
techniques . 

7.  Based  on  examination  of  the  data,  present  findings  to 
the  USAF  Academy  Hospital  Commander  with  recommendations  as 
to  the  most  appropriate  form  of  providing  appointment 
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services.  These  findings  could  include  a  totally 
centralized  or  totally  decentralized  or  a  combination  of 
these  two  appointment  configurations. 

Criteria 

The  following  criteria  guided  the  conduct  of  this  study  to 
ultimately  judge  the  appropriateness  and  feasibility  of  all 
f inal  recommendations : 

1.  Services  and  appointment  system  configuration 
recommendations  cannot  require  major  construction. 

2.  The  system  must  be  consistent  with  current  Department  of 
the  Air  Force  policies  and  regulations. 

3.  Implementation  of  the  recommendations  must  be  within  the 
authority  of  the  Commander,  USAF  Academy  Hospital. 

4.  Evaluate  recommended  methods  of  providing  appointment 
services  using  cost  effectiveness  analysis  techniques. 

Assumption 


In  pursuing  this  study,  it  was  assumed  that  no  mission  changes 
would  occur  during  the  research  period,  that  would  affect 
patient  beneficiaries  or  workload. 
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Limitations 

The  following  limitations  applied  to  the  pursuit  of  this  study: 

1.  The  1987  Air  Force  Health  Care  Survey  (shown  in  appendix 
H)  may  not  have  been  statistically  validated. 

2.  The  1987  Air  Force  Health  Care  Survey  results  was  not 
necessarily  a  statistically  random  sampling. 

3.  The  exact  number  of  appointment  transactions  made  by  the 
central  appointment  clerks  for  each  of  the  outpatient 
clinics  using  AQCESS  had  to  be  approximated  using  a 
combination  of  reports.  These  reports  contained  duplicative 
information  which  may  have  resulted  in  an  overstatement  of 
total  patient  visits. 
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Literature  Review 

"Rapid  growth  in  the  demand  for  ambulatory  care  has  placed 
increasingly  heavy  workloads  on  outpatient  clinics." 

(Steidley  and  Vanioh  1977,  359) 

The  appointment  system  is  the  patient’s  initial  access  to 
health  care  delivery,  and  it  is  also  one  of  the  most  complex 
problems  facing  today's  health  care  management  (Brandler  1983, 
24).  The  objective  of  any  outpatient  appointment  system  is  to 
minimize  patient  delays  and  optimize  available  resources  (Madden 
1976,  48).  To  accomplish  this  objective,  the  administrator  must 
balance  the  allocation  of  resources  (money,  space,  and  manpower) 
by  optimizing  the  relationships  among  the  priorities  of 
patients,  providers,  and  support  personnel  (Herpok  1980,  66). 

Appointment  systems  have  always  been  of  great  interest  to 
the  military  manager  and  to  such  large  multi-specialty  groups  as 
the  Kaiser-Permanente  Health  Maintenance  Organization  (Stuart 
1976,  392).  In  fact,  patient  appointment  scheduling  was  the 
number  one  item  on  the  USAF  Surgeon  General  information  systems 
top  ten  problem  list  for  FY  88  (Symposium,  1987).  In  addressing 
this  problem  area,  it  is  essential  that  the  outpatient 
appointment  system  be  flexible,  efficient,  and  effective.  This 
requirement  demands  that  the  appointment  system  be  constantly 
reviewed  by  physicians,  nurses  and  management  alike. 

Although  the  private  practice  physician  historically  has  had 
little  need  for  automated  appointment  scheduling  systems,  this 
appears  to  be  changing.  Between  1966  and  1986,  the  ambulatory 
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general  practice  physician  has  dramatically  increased  the  use  of 
appointment  systems.  By  1986,  over  80  percent  of  general 
practitioners  were  using  them  (Fishbacher  and  Robertson  1986, 
282). 

A  review  of  the  literature  revealed  that  most  of  the  patient 
appointment  system  articles  fall  into  three  groups;  (1)  patient 
waiting  time,  (2)  punctual ity /no  show  behavior,  and  (3)  patient 
flow  in  clinics.  In  addition,  there  is  very  little  literature, 
published  outside  the  military,  on  centralized  versus 
decentralized  patient  appointment  system  operations.  The 
military  and  a  few  large  multi-speciality  health  care  entities 
such  as  Kaiser-Permanente  provide  the  leadership  in  this  area. 

The  earliest  article  found,  relating  to  appointment  systems 
and  scheduling,  was  written  in  1952.  In  their  article,  Welch 
and  Bailey  discussed  appointment  scheduling  as  related  to  the 
punctuality  of  the  patients  and  the  providers.  They  also 
addressed  such  issues  as  patient  queues,  and  the  time  spent  by 
the  provider  in  consultation  with  each  patient.  Their  final 
conclusion  was  that  a  balance  must  be  struck  between  the  patient 
waiting  time  and  physician  idle  time  (Welch  and  Bailey  1952, 

1105  &  1108). 

Another  landmark  appointment  study  was  conducted  from  1968 
to  1973,  and  addressed  the  systems  and  procedures  for  outpatient 
flow  at  a  large  health  center.  It  specified  the  distinct 
advantages  of  both  a  centralized  and  a  decentralized  appointment 
system  (Reisman,  Joao  Mello  da  Silva  and  Mantel 1  1978,  42). 
Details  on  the  strengths  and  weaknesses  of  these  systems  are 
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shown  in  appendices  N  through  Q. 

In  1976  Edward  Madden  wrote  about  a  study  he  performed  on  a 
manual  centralized  appointment  system  during  design  of  a  new 
U.S.  Public  Health  Service  Hospital  in  New  Orleans.  He  noted 
that  a  decentralized  appointment  system  usually  had  no  central 
maneigement,  a  lack  of  coordination  between  departments,  and 
patient  delays.  He  also  found  that  one  of  the  main  advantages 
of  an  appointment  system  is  the  ability  to  schedule  future 
actions  and  events.  It  is  not  just  a  workload  accounting  system 
for  patients  as  used  by  many  clinics.  In  addition,  it  performs 
an  important  information  function  while  controlling  resource 
availability  (Madden  1976,  48  &  49). 

Another  appointment  system  initiative  involved  automation  at 
Children’s  Hospital  Medical  Center  in  Boston,  Massachusetts. 

The  article  stated  that  automation  brought  order  out  of  what  was 
a  chaotic  situation  in  the  appointment  of  over  150,000  patients 
annually.  This  increased  efficiency  in  handling  the  large 
numbers  of  patients  not  only  meant  savings  in  time  and  money  for 
patients,  but  reduced  the  hospital  costs  as  well  (Cronkhite 
1969,  55). 

Some  of  the  earliest  studies  of  centralized  versus 
decentralized  appointment  systems  were  accomplished  in  the  early 
1970’ s  by  the  Army  Health  Care  Studies  Division  at  Fort  Sam 
Houston,  Texas.  The  first  CAS  study  was  completed  in  January 
1973,  and  was  heavily  criticized  for  not  addressing  both  sides 
of  the  CAS  issue.  The  Army  Surgeon  General  had  already  decided 
to  designate  the  CAS  as  the  system  of  choice  prior  to 
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undertaking  this  study.  The  final  study  results  did  not  have  to 
defend  the  superiority  of  the  CAS,  but  simply  outlined  methods 
to  be  used  in  implementing  or  upgrading  an  existing  CAS  (Raiha, 
1985,  2). 

The  earlier  Army  study  did  have  some  benefits.  It  pointed 
out  that  central  appointment  systems,  having  computer  automation 
support,  had  a  distinct  advantange  (see  appendix  N)  over  the 
manual  systems  (Stuart  1973,  75).  A  follow-on  study,  conducted 
by  the  Army  in  1977,  concluded  that  justification  for  a  CAS 
csurinot  be  predicated  on  a  reduction  in  cost  or  a  demonstratable 
difference  in  patient  workload.  The  1977  study  went  on  to  state 
that  outpatient  appointment  systems  are  best  regulated  by  a 
combination  of  systems  providing  maximum  patient  accessibility 
to  the  levels  of  care  matching  the  patient's  need  (Alexander 
1977,  5).  This  study  also  provided  several  management 
recommendations  for  an  efficient  and  effective  PAS.  These 
included:  (1)  a  minimum  of  70  percent  of  outpatient  visits 
should  be  appointed  in  advance  of  patient  arrival;  (2)  90 
percent  of  the  professional  staff  should  have  a  favorable 
opinion  about  the  effectiveness  au:id  efficiency  of  the 
appointment  system;  (3)  clinical  personnel  should  spend  less 
than  10  percent  of  their  time  in  appointment-making  duties;  and 
(4)  system  flexibility  for  physicians  is  key  to  survival.  It 
was  also  noted  that  provider  productivity  improves  as  the  result 
of  the  control  euid  monitoring  mechanisms  used  in  conjunction 
with  a  centralized  system.  In  short,  the  success  or  failure  of 
the  centralized  appointment  system  is  not  solely  a  function  of 
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the  availability  of  adequate  resources.  The  study  also  warned 
not  to  underestimate  the  importance  of  the  time  spent  by  many 
CAS  clerks  in  providing  information  which  does  not  lead  to  the 
making  of  an  appointment  (Alexander  1977,  77  &  87). 

In  a  Graduate  Research  Project  for  Baylor  University  in 
1985,  Major  Raiha  noted  that,  at  Madigau  Army  Medical  Center, 
the  patients  using  a  decentralized  system  had  a  higher  overall 
opinion  of  the  patient  appointment  system.  Over  88  percent  of 
the  in-hospital  group,  who  used  a  decentralized  system, 
expressed  overall  satisfaction,  compared  to  63.3  percent  of 
those  using  the  centralized  system  (Raiha,  1985,  49). 

A  July  1987  article,  written  about  automation  of  patient 
appointments  in  the  Army,  cited  some  key  issues  and  components 
that  any  PAS  would  have  to  accomodate.  These  included:  (1) 
access;  (2)  availability;  (3)  management  data;  (4)  decentralized 
capability  for  individual  clinic  support;  and  (5)  a  clustering 
capability  to  allow  mini-centralized  systems  to  function 
(Palmer,  Wilson  and  Hubble  1987,  356).  The  beauty  of  automated 
appointment  systems  is  that  they  allow  centralized  management 
control,  but  also  allow  the  flexibility  of  a  decentralized 
operation  by  locating  the  devices  throughout  the  clinic  areas. 

Other  literature  stated  one  weakness  of  centralized 
appointment  systems  is  that  they  are  not  generally  set  up  to 
schedule  same-day  acute  appointments  (Singer,  Rossfeld,  and  Hall 
1976,  156).  In  many  high  volume  ambulatory  care  clinics,  a 
significant  number  of  patient  appointments  are  reserved  for 
same-day  acute  care.  These  are  almost  always  booked  directly  by 
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the  clinic.  The  same  article  addressed  an  aspect  of 
decentralization  which  impeded  efficient  workflow.  Direct 
face-to-face  communication  with  the  patient  in  the  clinic  often 
resulted  in  a  drop  in  productivity  in  the  reception  area. 
Patients  can  be  appointed  more  quickly  and  with  fewer 
interruptions  by  using  a  telephone  call-in  system  instead  of  a 
walk-up  window. 

A  1976  appointment  system  study  involved  a  survey  of  164 
staff  members  and  2,254  patients  in  four  military  hospitals 
(Stuart  1976,  393-394).  It  concluded  that:  (1)  as  many  clinics 
as  possible  should  be  on  the  CAS;  (2)  a  good  telecommunications 
system  is  essential;  (3)  busy  signals  should  be  6  percent  or 
less;  (4)  14  to  38  percent  of  the  CAS  calls  in  the  military 
hospitals  surveyed  were  for  information  only;  (5)  the  numbers  of 
physicians  served  per  clerk  ranged  from  6  to  24,  and  (6)  the 
maximum  number  of  telephone  calls  handled  per  clerk  per  day  was 
242. 

Another  article,  published  in  1986,  concerning  efficient  and 
effective  appointment  systems,  recommended  a  centralized 
appointment  system  where  patients  could  schedule  services  in  all 
departments  by  calling  one  central  number.  It  stated  that 
training  of  appointment  personnel  is  of  vital  importance. 
Furthermore,  it  emphasized  that  scheduling  personnel  must  be 
knowledgeable  of  departmental  and  procedure-specific 
information.  This  knowledge  is  needed  in  order  to  correctly 
appoint  patients  to  the  right  clinic  and  appointment  slot 
(Woerly  1986,  5). 


D.  Shields  16 


An  additional  key  aspect  of  appointment  systems  is  their 
ability  to  smooth  patient  flow  and  minimize  the  peak  and  valleys 
experienced  in  clinic  workloads  (Dickinson  1979,  225).  Many 
articles  reported  that  the  individual  appointment  is  superior  in 
smoothing  out  workload,  but  that  a  definite  lag  exists  in  its 
adoption  by  many  clinics.  The  block  or  wave  appointment  system, 
where  several  patients  are  directed  to  arrive  at  the  clinic  at 
the  same  time,  circumvents  many  of  the  best  features  in  an 
appointment  system.  It  increases  both  patient  waiting  times  and 
dissatisfaction,  and  demands  larger  patient  waiting  areas. 
Unfortunately,  many  clinics  still  use  a  block  form  of  scheduling 
and  report  extensive  patient  waiting  times.  Several  articles 
also  addressed  the  issue  that  walk-in  patients  do  not  recognize 
the  negative  impact  of  unplanned  visits  on  the  total  system 
(Cupit  1985,  141).  A  few  general  recommendations  which  have 
helped  many  appointment  systems  included:  (1)  doctors  starting 
sessions  on  time;  (2)  not  creating  a  pool  of  patients  at  the 
start  of  a  session;  (3)  making  sure  the  doctor  is  not 
distracted;  and  (4)  educating  doctors  and  others  about  effective 
operation  of  the  scheduling  system  (O'Keefe  1985,  709). 

The  Army  Health  Services  Command  has,  through  many  studies 
over  the  past  14  years,  established  management  indicators  for 
effective  and  efficient  hospital  appointment  systems.  These 
include:  (1)  walk-in  rates  should  not  exceed  10  percent  of  the 
total  patient  visits;  (2)  the  length  of  am  averaige  appointment 
transaction  should  not  exceed  2.5  minutes;  (3)  there  should  be 
one  appointment  clerk  for  approximately  every  2, 000  monthly 
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patient  contacts;  (4)  informational  calls  should  not  exceed  10 
percent  of  the  total  calls  received;  (5)  a  minimum  of  an  80 
percent  patient  satisfaction  rate  should  be  maintained;  (6) 
calls  placed  on  hold  should  not  exceed  one  minute;  (7)  there 
should  be  1.5  telephone  lines  for  every  appointment  clerk,  and 
(8)  busy  signals  should  not  exceed  6  percent  of  all  attempted 
calls  (HSC  PAM  40-7-1  1986,  8,  15,  26). 

Research  Methodology 

A  review  of  workload  and  staffing  changes  for  the  USAF 
Academy  was  analyzed  to  determine  if  they  would  have  any  impact 
on  the  appointment  process.  Using  historical  data  as  a  starting 
point,  the  options  and  impacts  of  a  centralized  or  decentralized 
appointment  service  were  analyzed  and  identified. 

Demographic  and  medical  care  data,  as  described  in  the 
objectives,  was  evaluated  to  determine  the  major  commonalities 
in  the  appointment  process,  the  patient  population,  and  to 
assist  in  determining  the  types  of  appointment  services  that 
should  be  provided  in  the  outpatient  clinics. 

Previous  appointment  aoid  clerical  workload  transactions  were 
analyzed  using  15  percent  of  the  annual  appointment  data  from  FY 
1987.  This  data  encompassed  the  August  and  September  1987 
AQCESS  appointment  transactions.  This  particular  PAS  data  was 
used  because  it  represented  15  percent  of  the  appointment 
transactions  and  was  considered  a  representative  sample.  The 
decision  to  use  this  time-period  and  the  15  percent  sample,  was 
based  on  the  recommendations  of  Resource  Management,  Patient 
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Affairs,  Information  Systems,  and  the  CAS  Supervisor.  The 
AQCESS  system  was  implemented  in  June  1987,  and  the  June  through 
July  1987  time-frame  was  felt  to  contain  potential  AQCESS 
appointment  system  startup  data  inconsistencies.  Due  to  patient 
and  staff  summer  rotations,  it  was  also  felt  that  both  the 
volume  of  appointments,  and  the  clinical  mix  of  June  and  July 
1987  appointments  might  not  be  representative  of  the  USAF 
Academy  Hospital.  Particular  attention  was  given  to  determining 
what  appointment  services  were  obtained  by  calling  the  central 
appointment  desk,  and  what  services  were  obtained  when  calling 
the  clinics  directly. 

The  projected  cost  of  any  personnel,  equipment,  supplies, 
renovation,  modification,  and  design  changes  in  the 
recommendation  was  calculated  based  upon  estimates  provided  by 
the  Patient  Affairs  Office,  Resource  Management  Office,  Medical 
Supply  Office,  Medical  Information  Systems,  Base  Civil  Engineer, 
and  the  Civilian  Personnel  Office  at  the  USAF  Academy.  The 
recommendations  were  evaluated  using  cost-effectiveness  analysis 
(CEA).  The  total  cost  (subjective,  operating,  personnel, 
equipment,  and  facility  modifications)  was  considered. 

A  descriptive  analysis  of  patient  satisfaction  levels  was 
undertaken  in  the  discussion  section  of  this  GRP.  The  analysis 
was  based  on  the  Air  Force  patient  survey  shown  in  appendix  H. 
This  survey  was  administered  to  the  four  top  Air  Force 
categories  of  beneficiaries,  with  at  least  60  persons  in  each 
category.  These  categories  included  Active  Duty,  Dependent  of 
Active  Duty,  Retiree,  and  Dependent  of  Retiree  or  Deceased 
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Member.  This  survey  was  not  necessarily  a  statistically  random 
sampling,  and  the  survey  instrument  was  not  statistically 
validated. 

The  staff  interview  survey,  shown  in  appendix  J,  was 
administered  to  all  46  personnel  involved  with  the  appointing 
scheduling  system  at  the  USAF  Academy  Hospital.  These  personnel 
encompassed  the  entire  staff  population  involved  with  the 
appointment  system.  A  descriptive  analysis  of  the  survey 
results  is  presented  in  the  discussion  section  of  this  GRP. 
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CHAPTER  II 
DISCUSSION 

The  discussion  of  this  research  effort  is  divided  into  two 
principal  sections;  (1)  patient  satisfaction,  and  (2)  staff 
satisfaction.  The  examination  of  the  satisfaction  levels 
includes  a  review  of  the  questionnaire  selection  and  the 
administration  of  the  questionnaires,  along  with  a  descriptive 
analysis  and  interpretation  of  the  results  of  the  surveys. 
Modifications  to  the  questionnaire  through  pre-testing  is  also 
discussed. 

This  USAF  Academy  Hospital  appointment  system  GRP  involved 
analyzing  patient  satisfaction  levels  through  the  use  of  the 
1987  Air  Force  Health  Care  Survey.  This  survey  questionnaire 
was  developed,  mandated,  and  administered  under  guidance  from 
the  Air  Force  Surgeon  General.  Measuring  the  staff  satisfaction 
involved  the  development  and  administration  of  a  hospital  staff 
survey.  While  patient  needs  are  always  the  first  and  foremost 
consideration,  the  needs  and  capabilities  of  the  individual 
staff  member  were  also  considered. 

Patient  Satisfaction  Questionnaire 

The  patient  satisfaction  rate  was  measured  using  the  1987 
Air  Force  Health  Care  Survey  (appendix  H).  This  survey 
instrument  contained  a  total  of  32  questions  covering  a  wide 
variety  of  areas.  Questions  were  included  on  patient 
demographic  data,  facility  information,  quality  of  care 
provided,  facility  appearance,  support  personnel,  laboratory. 
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pharmacy,  x-ray,  and  the  appointment  system.  This  particular 
survey  instrument  was  used  for  the  following  reasons; 

(1)  The  survey  was  already  developed  and  about  to  be 
administered  by  hospital  personnel  as  mandated  by  the  United 
States  Air  Force  (USAF)  Surgeon  General  (SG). 

(2)  The  patient  appointment  survey  used  contained  questions 
similiar  to  those  which  were  already  being  considered  for 
use  in  conjunction  with  this  research. 

(3)  Both  the  hospital  executive  management  and  this 
researcher  wanted  to  minimize  the  quantity  of  appointment 
system  questionnaires  the  hospital  staff  had  to  administer 
and  those  which  the  patients  had  to  complete. 

Because  the  particular  Air  Force  survey  used  covered  a  wide 
spectrum  of  services  and  care  provided  at  the  USAF  Academy 
Hospital,  several  questions  were  extracted  to  provide  a 
descriptive  measure  of  the  patient  satisfaction  levels  with  the 
USAF  Academy  Hospital  appointment  system.  The  questions  used 
included : 

(1)  Survey  question  number  1:  "What  is  your  beneficiary 
category?" 

(2)  Survey  question  number  4:  "If  you  do  not  receive  the 
majority  of  your  care  from  an  Air  Force  Medical  Treatment 
Facility,  which  one  of  the  following  best  explains  why 
not?" 

(3)  Survey  question  number  31;  "Using  the  scale  below, 
please  tell  us  how  satisfied  you  are  with  the  following 
services?"  This  question  used  a  Likert  scale  to  measure 
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satisfaction  ranging  from  "Very  Satisfied”  to  "Very 
Dissatisfied. " 

(4)  Survey  written  comments  question  (no  number):  "Please 
use  the  space  below  to  tell  us  what  you  think  about  the  way 
we  are  providing  medical  care.  Your  comments  will  be 
compiled  and  will  be  used  by  the  executive  management  of 
this  medical  treatment  facility  in  making  decisions  for 
change. " 


Fielding  the  Patient  Survey 

The  patient  survey  instrument  (shown  in  appendix  H)  was 
administered  to  279  patients  at  the  USAF  Academy  Hospital  during 
December  1987,  and  January  1988.  It  is  important  to  recognize 
that  the  patient  satisfaction  rates  were  obtained  from  a  limited 
group.  While  this  small  group  does  not  allow  generalization  to 
the  patient  population  as  a  whole,  or  the  determination  of 
opinion  trends,  it  does  provide  a  clear  appreciation  for  popular 
concerns  among  the  patients. 

The  survey  instructions  mandated  that  it  be  administered  to 
the  top  four  Air  Force  categories  of  beneficiaries,  with  at 
least  60  persons  in  each  category.  These  four  categories  were 
Active  Duty,  Dependent  of  Active  Duty,  Retiree,  and  Dependent  of 
Retiree  or  Deceased  Member.  These  patients  were  chosen  at 
random  from  those  who  presented  for  care  at  the  USAF  Academy 
Hospital.  The  survey  was  not  necessarily  a  statistically  random 
sampling,  and  the  survey  instrument  may  not  have  been 


statistically  validated. 
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The  survey  was  administered  by  a  designated  hospital 
employee  under  guidance  from  the  Air  Force  Surgeon  General. 

This  employee  asked  patients  who  were  waiting  in  the  central 
lobby  area  to  complete  the  survey.  The  respondents  were 
patients  from  all  outpatient  areas  in  the  hospital.  They 
included  patients  who  were  picking  up  medical  records,  waiting 
for  their  pharmaceutical  prescriptions  to  be  filled,  or  waiting 
for  other  general  clinical  appointments. 

Analysis  of  Patient  Satisfaction  Results 
The  complete  1987  Air  Force  Health  Care  survey  results  are 
shown  in  appendix  X.  An  analysis  of  significant  responses  to 
survey  questions  number  1  and  31,  are  shown  in  Table  1.  In 
aggregate,  only  48  percent  of  the  279  patients  surveyed  were 
satisfied  or  very  satisfied  with  the  appointment  system.  As 
shown  in  Table  1,  there  is  much  room  for  improvement  in  patient 
satisfaction  levels. 

Table  1 


Overall  Appointment 

Satisfaction  Category 

System 

Satisfaction 

Total 

Percentage 

Total 

Number 

Very  Satisfied/Satisfied 

48% 

33 

Neutral 

18% 

50 

Very  Dissatisfied/Dissatisfied 

33% 

92 

No  Response 

1% 

4 

TOTAL: 

100% 

279 

Source:  1987  Air  Force  Health  Care  Survey  (appendix  X) 
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It  was  perhaps  more  revealing  to  analyze  the  individual 
category  of  respondents  to  determine  differences  in  satisfaction 
levels  as  shown  in  Table  2.  The  active  duty  personnel  had  the 
largest  dissatisfaction  rate  (48  percent)  with  the  appointment 
system.  In  contrast,  a  total  of  62  percent  of  the  retirees  were 
satisfied  or  very  satisfied  with  the  appointment  system. 

Table  2 

Beneficiary  Appointment  System  Satisfaction 


Beneficiary  Category 

Active 

% 

Duty 

# 

Retiree 
%  if 

Very  Satisfied/Satisfied 

32% 

21 

62% 

49 

Neutral 

20% 

13 

10% 

8 

Very  Dissatisfied/Dissatisfied 

48% 

32 

26% 

20 

No  Response 

- 

- 

2% 

2 

TOTAL: 

100% 

66 

100% 

79 

Source:  1987  Air  Force  Health  Care  Survey  (appendix  X) 

It  was  also  revealing  to  analyze  specific  areas  of 
satisfaction  and  dissatisfaction  based  on  the  written  comments 
included  on  the  patient  survey.  A  total  of  26.2  percent  of 
those  surveyed  (73  patients)  chose  to  make  118  separate  written 
comments.  Of  this  group,  41  percent  (48  total  comments)  were 
considered  positive  in  nature  and  were  issues  of  patient 
satisfaction.  The  remaining  59  percent  of  the  comments  (70 
total)  were  considered  negative  in  nature  and  were  categorized 
as  issues  of  patient  dissatisfaction.  These  positive  and 
negative  comments  were  stratified  as  shown  in  Table  3. 
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Table  3 

Patient  Survey  Written  Comments 


Category 

Positive 

%  a 

Negative 
%  » 

General  Courtesy  &  Treatment 

90% 

43 

10% 

7 

Pharmacy 

2% 

1 

7% 

5 

Family  Practice  Clinic 

4% 

2 

11% 

8 

Facility  Parking 

2% 

1 

- 

- 

Appointment  System 

2% 

1 

29% 

20 

Overall  Comment 

- 

- 

6% 

4 

Physical  Plant 

- 

- 

3% 

2 

Lack  of  Services 

- 

- 

9% 

6 

Dental 

- 

- 

1% 

1 

Emergency  Room 

- 

- 

3% 

2 

OB  Ward  and  Nursery 

- 

- 

4% 

3 

Radiology 

- 

- 

4% 

3 

Aerovac  System 

- 

- 

1% 

1 

Medical  Records 

- 

- 

9% 

6 

Peterson  Field  Clinic 

“ 

- 

3% 

2 

TOTAL: 

100% 

48 

100% 

70 

Source:  1987  Air  Force 

Health  Care 

Survey 

(appendix 

X) 

In  summary.  Table  3  shows  that  the  appointment  system 
represented  the  largest  area  of  patient  dissatisfaction.  More 
specifically,  difficulty  in  getting  an  appointment  and  the 
waiting  time  for  appointments  were  the  most  frequently  indicated 
reason  for  patient  dissatisfaction  with  the  central  appointment 
system  at  the  Air  Force  Academy  Hospital.  Although  this  area 
represents  a  very  small  segment  of  the  patients  surveyed,  it 
still  may  be  indicative  of  a  problem  or  larger  trend. 

The  final  patient  survey  question  that  was  analyzed  was 
question  number  4:  "If  you  do  not  receive  the  majority  or  your 
care  from  an  Air  Force  Medical  Treatment  Facility,  which  one  of 
the  following  best  explains  why  not?". 
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Table  4 

Reasons  For  Not  Seeking  Care  At  The  Air  Force  Academy 


Not  Applicable  No  Response 


Category  of  Survey  Respondent 

% 

% 

Active  Duty  Military  Member 

86% 

57 

8% 

5 

Active  Duty  Dependent 

74% 

49 

20% 

13 

Retired  Military  Member 

75% 

59 

13% 

10 

Retired  Military  Dependent 

51% 

34 

34% 

22 

TOTAL; 

72% 

199 

18% 

50 

Source:  1987  Air  Force  Health  Care 

Survey 

( appendix 

X) 

In  summary,  a  total  of  249  patients  out  of  279  surveyed  (90 
percent)  chose  "not  applicable",  or  "no  response"  on  this 
question.  As  shown  in  table  4,  this  question  yielded  little 
additional  information  on  patient  dissatisfaction  with  the 
appointment  system.  A  better  and  more  complete  approach  would 
have  been  to  survey  all  eligible  beneficiaries  in  the  catchment 
area. 
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Staff  Satisfaction  Questionnaire 
A  survey  of  the  USAF  Academy  Hospital  staff  who  were 
involved  with  the  appointment  system  was  also  undertaken.  This 
survey  involved  the  entire  population,  a  total  of  46  staff 
members  which  included  all  personnel  associated  with  the 
appointment  process.  These  staff  members  included  executive 
management,  department  managers/supervisors,  appointment  clerks, 
clinic  non-commissioned  officers  (NCOs),  clinic  charge  nurses, 
psychologist,  optometrist,  nutritionist,  audiologist,  and 
physicians.  The  researcher  and  hospital  executive  management 
were  very  much  in  favor  of  a  100  percent  staff  survey  of  those 
persons  who  were  involved  with  the  appointment  system.  It  was 
felt  that  the  population  was  sufficiently  small  that  a  100 
percent  survey  was  reasonable,  and  that  if  performed  by 
appointment  with  the  researcher  present,  a  total  response  rate 
of  100  percent  was  very  possible. 

Staff  Questionnaire  Design 
The  staff  survey  instrument  is  shown  in  appendix  I 
(pre-test)  and  in  appendix  J  (post-test).  The  questionnaire  was 
reviewed  and  approved  by  the  Hospital  Executive  Committee  prior 
to  being  used.  The  survey  instrument  was  designed  to  fit  on  two 
sheets  of  paper  printed  on  both  sides.  The  first  page  contained 
three  introductory  paragraphs  and  was  signed  by  the  Hospital 
Commander.  The  first  paragraph  described  the  purpose  of  the 
survey.  It  explained  that  the  hospital  executive  management 
wanted  to  know  how  the  staff  members  felt  about  the  appointment 
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system.  The  second  paragraph  emphasized  that  all  answers  should 
be  based  only  on  their  experience  with  the  appointment  system  at 
the  USAF  Academy  Hospital,  and  not  on  experiences  they  may  have 
had  at  other  MTFs. 

The  format  of  the  survey  questionnaire  was  deliberately  kept 
short  and  the  researcher  used  a  Likert  scale  so  that  responses 
could  be  measured  across  a  continuum  from  “Not  Applicable, " 

"Very  Satisfied, "  "Satisfied, "  "Neither  Satisfied/Dissatisfied, " 
"Dissatisfied, "  to  "Very  Dissatisfied. " 

The  demographic  information  was  requested  first,  based  on 
three  questions.  This  information  included:  position  title, 
tenure  in  present  position,  and  clinic  or  duty  section.  The 
information  sequencing  under  position  title,  and  clinic/duty 
section  was  random.  The  sequencing  under  the  tenure  question 
was  listed  from  the  fewest  number  of  months  in  the  current 
position,  to  more  than  three  years  in  a  position.  The  top  end 
(three  years)  was  felt  to  be  the  break  point  as  approximately 
one  third  of  the  Academy  Hospital  staff  departs  each  year.  It 
was  felt  that  tenure  beyond  the  point  when  most  of  the  staff 
normally  rotates,  would  be  of  little  use.  It  was  also  felt  that 
all  these  demographic  areas  would  provide  useful  insight  and 
stratification  of  staff  satisfaction  levels. 

The  next  section  contained  six  questions  which  were  used  to 
measure  satisfaction  or  dissatisfaction  (using  a  Likert  scale) 
concerning  the  staff  members’  feelings  about  the  appointment 
system  used  at  the  USAF  Academy  Hospital.  The  last  page 
contained  two  open-ended  questions.  The  first  question  was: 
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"If  you  could  change  anything  about  the  appointment  system,  what 
would  it  be?"  The  second  question  was:  "How  would  one 
additional  full-time  appointment  clerk  affect  the  patient  care 
provided  in  your  area?"  These  open  ended  questions  were  asked 
so  that  the  staff  members  surveyed  could  provide  aulditional 
insight  into  the  appointment  system  operation  which  might  be 
changed  to  help  them  in  the  performance  of  their  duties. 

Discussions  with  many  individuals  knowledgable  about  survey 
techniques  were  indispensable  to  the  development  of  this  survey 
instrument.  These  people  included  Lieutenant  Colonel  William  H. 
Clover  at  the  CJSAF  Academy  and  Lieutenant  Colonel  Arthur  L. 
Badgett  at  Evans  Community  Hospital,  Fort  Carson,  Colorado. 

Both  persons  were  very  familiar  with  survey  composition  and 
analysis  and  were  invaluable  in  the  development  of  a  pre-test 
questionnaire.  Their  insight  led  the  researcher  to  include  a 
column  on  the  questionnaire  labeled:  "Not  Applicable. "  This 
choice  was  included  to  to  reduce  the  possibility  of  inaccurate 
force  choice  responses;  i.e.,  a  staff  member  forced  to  choose 
along  a  scale  from  "Very  Satisfied, "  to  "Very  Dissatisfied, " 
when  the  question  was  "Not  Applicable, "  could  result  in  the 
inaccurate  responses  being  given  equal  weight  with  other 
responses  which  would  be  more  valid. 

Pre-test  of  Staff  Questionnaire 

The  pre-test  included  a  total  of  nine  persons  (20  percent) 
of  the  intended  population  to  be  surveyed.  The  average  time 
required  to  complete  the  survey  was  3  minutes  and  30  seconds. 
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The  actual  pre-test  times  ranged  from  a  low  of  2  minutes  and  10 
seconds,  to  a  high  of  3  minutes  and  58  seconds.  Several 
excellent  suggestions  were  received  during  the  pre-test  which 
improved  the  survey  instrument. 

These  suggestions  included  eliminating  questions  which  were 
redundant  and  rewording  others  which  generated  confusion. 

Several  duty  title  areas  were  added,  along  with  asking  the  staff 
member  to  identify  the  clinic  or  department  area  in  which  they 
worked.  A  few  of  the  questions  were  revised  to  be  more 
specific,  the  sequencing  of  the  opinion  questions  was  changed  to 
allow  related  questions  to  be  grouped  together,  and  the  overall 
opinion  of  the  appointment  system  was  placed  last  instead  of 
first.  By  incorporating  all  these  suggestions,  the  survey 
instrument  was  reduced  to  two  pages,  with  a  total  of  11 
questions. 


Fielding  the  Staff  Survey 

The  survey  instrument  fielded  in  this  GRP  is  shown  in 
appendix  J.  All  surveys  were  administered  by  the  researcher 
between  18  December  1987  and  5  January  1988.  It  took 
approximately  20  total  hours  to  administer  to  the  hospital 
staff.  An  appointment  was  made  separately  with  each  staff 
member  surveyed  to  ensure  a  quiet  environment.  In  addition,  the 
surveyor  was  present  during  each  survey  to  encourage  100  percent 
completion  and  answer  any  questions  that  might  have  arisen.  The 
survey  completion  rate  was  100  percent  euid  relatively  few 
questions  were  asked.  The  staff  members  were  told  that  survey 


results  would  be  summarized  and  presented  to  executive 
management  and  that  individual  responses  would  be  held  in  strict 
confidence. 

Analysis  of  Staff  Satisft^ction  Results 
A  total  of  46  USAF  Acsulemy  staff  members  were  surveyed  using 
the  questionnaire  in  appendix  J.  Of  those  surveyed,  a  total  of 
34  staff  members,  representing  74  percent,  were  either  satisfied 
or  very  satisfied  with  the  appointment  system.  A  total  of  6 
persons  (13  percent)  were  neither  satisfied  or  dissatisfied,  and 
6  persons  (13  percent)  were  either  dissatisfied  or  very 
dissatisfied  with  the  appointment  system.  As  shown  in  Table  6, 
with  only  a  74  percent  overall  satisfactiv  rate,  there  is  much 
room  for  improvement. 

Table  5 

Overall  Summary  Of  Staff  Responses 


Total  Total 

Satisfaction  Category  Percentage  Number 

Very  Satisfied/Satisfied  74%  34 

Neither  Satisfied  Nor  Dissatisfied  13%  6 

Very  Dissatisfied/Dissatisfied  13%  6 


TOTAL:  100%  46 


Source:  Summary  Of  Staff  Responses  (appendix  U) 

The  staff  members  also  made  43  written  comments  concerning 
how  to  improve  the  appointment  system  (Table  6).  A  total  of  30 
percent  of  the  comments  were  related  to  errors  in  procedure  or 
knowledge  attributable  to  training  deficiencies  or 
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forgetfulness.  These  could  be  rather  easily  resolved  by 
refresher  training.  An  additional  26  percent  of  the  comments 
were  directed  to  policy  issues  (perceived  or  real).  These  could 
be  resolved  by  policy  clarifications  aimed  at  increasing 
communications.  Furthermore,  28  percent  of  the  comments  were 
related  to  improvements  by  tailoring  the  system  through  both 
centralization  and  decentralization.  These  changes  include 
bringing  OB/GYN  clinic  into  the  automated  system,  allowing  some 
clinics  to  book  their  own  appointments,  and  allowing  other 
clinics  to  shift  the  booking  of  some  appointment  types  to  the 
CAS. 

Table  6 

Staff  Survey  Written  Comments  -  I 


Total  Total 

Category  Percentage  Number 


Training  Deficiencies/Forgetfulness  30%  13 
Policy  Issues  26%  11 
Tailor  System  (Centralize/Decentralize)  28%  12 
Computer  Software  Changes  16%  7 


TOTAL:  100%  43 


Source:  Appointment  System  Staff  Written  Comments  (appendix  W) 

The  final  written  survey  question  (How  would  one  additional 
full-time  appointment  clerk  affect  the  patient  care  provided  in 
your  area?)  also  generated  24  written  comments  from  the  staff. 
The  majority  of  the  comments  (71  percent)  indicated  that  this 
would  improve  patient  care  and  accessibility,  while  29  percent 
of  the  comments  were  negative  in  nature.  Nearly  75  percent  of 


the  negative  comments  were  related 

to  the 

clinic 

being  so 

smal  1 

that  not  enough  workload  would  be  ; 

present 

to  keep 

a  clerk 

busy. 

The  stratification  of  responses  is 

shown 

in  Table 

7. 

Table  7 

Staff  Survey  Written 

Comments  -  II 

Positive 

Negative 

Category 

% 

% 

General  Comments 

23% 

4 

43% 

3 

Appointment  Accessibility 

42% 

7 

- 

- 

Grouping/Co- located  Clinics 

23% 

4 

- 

- 

Contingent  Comments  (Space) 

12% 

2 

57% 

4 

TOTAL : 

100% 

17 

100% 

7 

Source:  Appointment  System  Staff  Comments  (appenriix  W) 

An  analysis  of  the  demographic  responses  (Table  8)  revealed 
that  the  top  five  categories  of  respondents  were  clinic  NCOs, 
physicians,  department  managers/supervisors,  allied  health  care 
professionals  (either  a  psychologist,  physician  assistant, 
optometrist,  nutritionist,  or  an  audiologist),  and  appointment 
clerks.  The  staff  members  worked  in  a  total  of  18  different 
hospital  or  clinic  areas. 
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Table  8 

Classification  Of  Staff  Responses 


Category 

Total 

Percentage 

Total 

Number 

Clinic  NCOS 

28.2% 

13 

Physicians 

23.9% 

11 

Department  Managers/Supervisors 

13.  1% 

6 

Allied  Health  Care  Professionals 

10.  9% 

5 

Appointment  Clerks 

10.  9% 

5 

Clinic  Nurses 

6.5% 

3 

Executive  Managers 

6.5% 

3 

TOTAL; 

100% 

46 

Source:  Classification  of  Staff  Responses  (appendix  R) 

Analysis  of  Staff  Question  Number  Four  Results 
An  analysis  of  question  number  four  (the  staff  member's 
ability  to  obtain  patient  and  schedule  information  from  the 
appointment  system)  revealed  that,  of  the  46  staff  members 
surveyed,  80.4  percent  were  satisfied  or  very  satisfied.  In 
addition,  five  persons  (10.9  percent)  marked  this  as  not 
applicable.  As  shown  in  Table  9,  this  area  requires  little 
improvement. 


Table  9 

Staff  Responses  -  Question  Four 


Total  Total 

Satisfaction  Category  Percentage  Number 


Very  Satisfied/Satisfied  80.4%  37 
Not  Applicable  10.9%  5 
Neither  Satisfied  Nor  Dissatisfied 

Very  Dissatisfied/Dissatisfied  8.7%  4 


TOTAL:  100%  46 


Source:  Summary  Of  Staff  Responses  (appendix  U) 


Analysis  of  Staff  Question  Number  Five  Results 
The  analysis  of  question  number  five  (How  satisfied  are  you 
that  the  central  appointment  clerk  matches  the  patient  with  the 
proper  appointment  slot?)  revealed  that  of  the  46  staff  members 
surveyed,  6  persons  (13  percent  of  the  staff)  indicated  that 
they  were  were  dissatisfied  or  very  dissatisfied.  In  addition, 
26  percent  indicated  that  this  question  did  not  apply  to  them 
because  they  make  all  their  own  appointments  in  the  clinic.  As 
shown  in  Table  10,  this  area  requires  little  improvement. 


Table  10 

Staff  Responses  -  Question  Five 


Satisfaction  Category 

Total 

Percentage 

Total 

Number 

Very  Satisfied/Satisfied 

50.  1% 

23 

Not  Applicable 

26.0% 

12 

Neither  Satisfied  Nor  Dissatisfied 

10.  9% 

5 

Very  Dissatisfied/Dissatisfied 

13. 0% 

6 

TOTAL 

;  100% 

46 

Source;  Summary  Of  Staff  Responses  (appendix  U) 


Analysis  of  Staff  Question  Number  Six  Results 
The  analysis  of  question  number  six  (How  satisfied  are  you 
with  your  ability  to  contact  the  central  appointment  clerk  when 
you  need  to?)  revealed  that  12  persons  (26  percent  of  the  staff) 
marked  this  as  not  applicable  because  they  book  all  the 
appointments  directly  in  the  specialty  clinics.  Furthermore,  30 
persons  (65.4  percent)  were  either  satisfied,  or  very  satisfied. 
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and  2  persons  (4.3  percent)  were  dissatisfied.  As  shown  in 
Table  11,  this  area  requires  little  improvement. 


Table  11 


Staff  Responses  -  Question  Six 


Satisfaction  Category 


Very  Satisfied/Satisfied 
Not  Applicable 

Neither  Satisfied  Nor  Dissatisfied 
Very  Dissatisfied/Dissatisfied 


Total 

Percentage 


TOTAL: 


65.4% 
26.0% 
4.  3% 
4.  3% 

100% 


Total 

Number 


Source:  Summary  Of  Staff  Responses  (appendix  U) 


Analysis  of  Staff  Question  Number  Seven  Results 
The  analysis  of  question  number  seven  (How  satisfied  are  you 
with  the  number  of  appointment  scheduling  people  in  your  area?) 
revealed  that,  of  the  46  staff  members  surveyed,  28  persons 
(60.8  percent)  were  either  satisfied  or  very  satisfied.  As 
shown  in  Table  12,  a  slight  improvement  in  staff  satisfaction 
can  be  obtained  by  tailoring  the  appointment  system.  This 
tailoring  can  be  achieved  through  centralizing  or  decentralizing 
some  appointment  workload. 
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Table  12 

Staff  Responses  -  Question  Seven 


Satisfaction  Category 

Total 

Percentage 

Total 

Number 

Very  Satisfied/Satisfied 

60.8% 

28 

Not  Applicable 

15.3% 

7 

Neither  Satisfied  Nor  Dissatisfied 

10.9% 

5 

Very  Dissatisfied/Dissatisfied 

13.0% 

6 

TOTAI, 

100% 

46 

Source:  Summary  Of  Staff  Responses  (appendix  U) 


Analysis  of  Staff  Question  Number  Eight  Results 
The  analysis  of  question  number  eight  [How  satisfied  would 
you  be  if  all  appointments  were  made  in  the  clinic  area  (given 
no  additional  staftingjV]  revealed  that  10  persons  (21.7 
percent)  were  satisfied  or  very  satisfied,  and  26  persons  (56.6 
percent)  were  either  dissatisfied  or  very  dissatisfied.  It  is 
interesting  to  note  as  shown  in  Table  13,  that  nearly  22  percent 
of  the  staff  desire  to  operate  a  decentralized  appointment 
system  even  if  no  additional  staffing  is  available. 


Table  13 

Staff  Responses  -  Question  Eight 


Satisfaction  Category 

Total 

Percentage 

Total 

Number 

Very  Satisfied/Satisfied 

21.7% 

10 

Not  Applicable 

8.7% 

4 

Neither  Satisfied  Nor  Dissatisfied 

13.0% 

6 

Very  Dissatisfied/Dissatisfied 

56.6% 

26 

TOTAL 

:  100% 

46 

Source:  Summary  Of  Staff  Responses  (appendix  U) 
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The  responses,  when  stratified  by  clinic  or  work  area, 
revealed  that  in  many  of  the  specialty  clinic  areas  (Surgery, 
Acute  Care,  Orthopedic/Podiatry,  Nuclear  Medicine,  and 
ENT/Audiology)  the  staff  members  were  satisfied  or  very 
satisfied  with  this  proposal.  In  contrast,  some  clinics  (such 
as  Feunily  Practice  and  Pediatrics)  were  very  dissatisfied  with 
this  proposal  and  wanted  to  shift  additional  workload  to  the 
CAS.  In  addition,  of  the  5  central  appointment  clerks,  60 
percent  were  very  dissatisfied  by  the  proposed  decentralized 
system.  The  decentralized  proposal  would  not  eliminate  any  CAS 
positions,  but  would  relocate  the  employees  to  the  clinic 
areas . 
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CHAPTER  III 
CONCLUSIONS 

In  formulating  the  conclusions  and  recommendations  in  this 
GRP,  an  indepth  look  at  staff  satisfaction  rates  at  the  USAF 
Academy  Hospital  was  undertaken.  The  patient  satisfaction  rates 
were  also  measured  using  a  small  sample  and  a  survey  instrument 
developed  by  the  Air  Force  Surgeon  General  staff.  It  is 
important  to  recognize  that  the  patient  satisfaction  rates  were 
obtained  from  a  limited  group.  While  this  small  group  does  not 
allow  generalization  to  the  patient  population  as  a  whole,  or 
the  determination  of  opinion  trends,  it  does  provide  a  clear 
appreciation  for  popular  concerns  among  the  patients.  The 
conclusions  were  based  on  the  patient  survey,  the  staff 
population  survey,  and  on  the  literature  reviewed. 

An  extensive  search  for  ambulatory  care  performance 
indicators  was  conducted  during  the  literature  review  performed 
earlier  in  this  GRP.  The  majority  of  the  outpatient  ambulatory 
care  management  indicators  found,  were  those  published  by  the 
Army  Health  Services  Command.  These  management  indicators  were 
used  as  a  guide  in  arriving  at  the  conclusions  and 
recommendations  in  this  GRP. 

One  management  indicator  was  found  in  the  patient 
satisfaction  questionnaire.  The  eufialyzed  results  revealed  that 
only  48  percent  of  the  patients  were  satisfied  with  the  present 
appointment  system.  The  active  duty  component  of  the  patient 
population  surveyed  had  only  a  32  percent  overall  satisfaction 
rate  with  the  present  appointment  system.  The  published 


D.  Shields  40 


steuidards  (HSC  PAM  40-7  1986,  15)  call  for  a  minimum  goal  of  an 
80  percent  patient  satisfaction  rate  with  military  outpatient 
appointment  systems.  Using  this  management  indicator  as  a 
yard-stick,  significant  improvement  (a  minimum  of  a  32  percent 
improvement)  in  the  Academy  Hospital  outpatient  appointment 
system  is  apparently  needed. 

Specific  analysis  of  the  written  patient  comments  pointed 
out  the  difficulty  in  getting  through  to  CAS  clerks. 

Specifically,  difficulty  in  getting  an  appointment  and  waiting 
time  for  appointments  were  the  most  frequently  indicated  reasons 
for  patient  dissatisfaction  with  the  CAS  at  the  Air  Force 
Academy  Hospital. 

Another  management  indicator  was  revealed  in  the  call 
sequencer  system  survey  conducted  in  December  1987  (appendix  G). 
It  showed  that,  on  the  average,  58  percent  of  the  calls  to  CAS 
were  placed  on  hold  in  excess  of  one  minute  (69  seconds).  The 
duration  of  the  calls  placed  on  hold,  ranged  from  one  second,  to 
8  minutes  and  59  seconds.  This  result  was  compared  to  standards 
cited  earlier  in  the  literature  review,  that  calls  placed  on 
hold  should  not  exceed  one  minute  (HSC  PAM  40-7-1  1986,  27). 

Much  improvement  is  also  needed  in  this  area. 

Another  management  indicator  was  revealed  by  the  analysis  of 
the  staff  questionnaire.  This  survey  showed  that  only  74 
percent  of  the  overall  staff  indicated  satisfaction  with  the 
present  outpatient  appointment  system.  The  standards,  as  cited 
earlier  in  the  literature  review  (Alexander  1977,  5)  revealed 
that  90  percent  of  the  professional  staff  should  have  a 
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favorable  opinion  about  the  appointment  system.  Using  this 
statistical  standard  as  a  yard-stick,  significant  improvement  (a 
minimum  of  a  16  percent  improvement)  in  the  Aceuiemy  Hospital 
outpatient  appointment  system  is  apparently  needed  to  meet  the 
minimum  expectations  of  the  staff. 

The  largest  overall  dissatisfaction  with  the  appointment 
system  came  from  the  physician  category,  where  36  percent  were 
dissatisfied.  In  general,  when  looking  at  individual  questions 
of  appointment  system  support  characteristics,  the  highest 
dissatisfaction  was  indicated  by  those  clinics  that  relied  on 
the  central  appointment  system  for  their  appointment  support. 

All  but  one  clinic  (cardiopulmonary)  who  booked  their  own 
appointments  were  satisfied  with  their  current  decentralized 
appointment  system  configuration. 

It  was  also  interesting  to  note  specific  staff 
dissatisfaction  as  indicated  by  their  written  comments.  The 
staff  members  made  43  written  comments.  An  analysis  of  these 
written  comments  revealed  that  30  percent  were  related  to  errors 
in  procedure  or  basic  appointment  system  operation/knowledge. 

The  written  comments  also  recommended  freeing  up  clinic 
technician  and  nurse  time  spent  making  appointments,  so  that  the 
staff  can  spend  more  time  with  direct  patient  care  and  physician 
support  activities.  In  addition,  28  percent  of  the  comments 
were  categorized  as  tailoring  the  system  by  shifting  a  portion 
of  the  appointment  workload  currently  performed  in  the  clinics 
to  the  CAS. 

Furthermore,  discussions  with  the  hospital  staff  revealed 
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that  the  OSAF  Academy  Hospital  OB/GYN  clinic  currently  operates 
dual  appointment  books  (manual  and  automated).  This  mix  of  both 
manual  and  automated  schedules,  has  often  resulted  in 
double-booked  providers.  This  double  booking  increases  both  the 
patient  and  the  staff  dissatisfaction  levels.  As  pointed  out 
earlier  in  the  GRP  literature  review,  automated  systems  (such  as 
AQCESS)  smooth  patient  flow,  and  minimize  the  peak  and  valley 
extremes  in  workload  (Dickinson  1979,  225).  Furthermore,  it  was 
noted  that  the  OB/GYN  clinic  uses  the  block  or  wave  type 
appointing  process  described  earlier  in  this  GRP,  This  process 
circumvents  many  of  the  best  features  of  an  automated 
appointment  system.  This  wave  scheduling  process  increases 
patient  waiting  time,  results  in  the  need  for  larger  waiting 
areas,  and  increases  patient  dissatisfaction  levels  (Cupit  1985, 
141). 

The  key  to  any  successful  appointment  system,  as  cited  by 
the  literature,  is  having  the  flexibility  to  accommodate  patient 
and  staff  needs  (Alexander  1977,  77).  This  flexibility  can  be 
achieved  by  tailoring  the  appointment  system  to  the  individual 
needs  of  the  clinics  and  patients  while  still  maintaining 
central  management  oversight  over  productivity  eund  control. 

This  tailoring  process  should  be  geared  toward  increasing  clinic 
flexibility,  while  increasing  patient  and  staff  satisfaction 
levels. 

The  many  written  comments  provided  by  the  patients  and  the 
hospital  staff,  frequently  included  nonappointment  system 
aspects  of  satisfaction  and  dissatisfaction.  These  comments 
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were  provided  to  the  hospital  executive  management  for  their 
use,  information,  and  action. 

The  literature  and  survey  data  cited  throughout  this  GRP 
supports  the  need  for  an  appointment  system  responsive  to  the 
needs  of  not  only  the  patient,  but  also  the  staff.  It  is 
apparent  that  changes  in  the  USAF  Academy  Hospital  outpatient 
appointment  system  must  be  made  to  improve  patient  and  staff 
satisfaction  levels. 


CHAPTER  IV 
RECOMMENDATIONS 

Based  on  the  survey  data,  the  literature  reviewed,  and  the 
foregoing  conclusions,  the  following  recommendations  are  made. 
First,  the  staff  members  made  43  written  comments  concerning 
improving  the  appointment  system.  A  total  of  30  percent  of  the 
comments  were  related  to  errors  in  procedure  or  knowledge 
attributed  to  training  deficiencies  or  forgetfulness.  These 
could  be  resolved  by  refresher/inservice  training.  Second,  an 
additional  26  percent  of  the  written  staff  comments  were 
attributed  to  policy  issues  (perceived  or  real).  These  could  be 
resolved  by  the  clarification  of  policies,  increased 
communications,  and  changes  in  the  appointment  system.  Third, 

28  percent  of  the  comments  promoted  appointment  system  changes 
that  allowed  the  system  to  be  tailored  by  centralizing  some 
functions  and  also  decentralizing  some  of  the  appointment 
functions  emd  responsibility. 

The  tailoring  of  the  appointment  system  to  the  needs  of  the 
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clinics,  while  increasing  patient  accessibility,  as  pointed  out 
in  the  surveys,  involves  several  areas.  First,  it  is  important 
that  all  outpatient  clinics  operate  within  the  same  automated 
appointment  system  for  continuity  and  consistency  of  operations. 
This  recommendation  involves  the  OB/GYN  clinic  which  currently 
uses  a  combination  of  both  manual  and  automated  appointment 
schedules.  All  OB/GYN  appointment  functions  should  be 
accomplished  in  one  appointment  system  (in  this  case  the 
hospital  standardized  AQCESS  system).  The  AQCESS  system  would 
match  patient  arrivals  with  provider  time  slots,  smooth  the 
appointment  flow,  and  reduce  the  patient  waiting  time  in  the 
clinic  lobby.  This  recommendation  should  lead  to  improved 
patient  and  staff  satisfaction  levels. 

Second,  the  system  should  be  tailored  by  centralizing  the 
appointment  workload  associated  with  small  clinics,  so  that 
technicians  and  nurses  can  spend  more  time  with  direct  patient 
care  activities.  This  recommendation  involves  changing  he  mix 
of  the  type  of  appointments  booked  only  by  the  clinic,  and  only 
by  the  CAS.  One  specific  recommendation  involves  the  shifting 
of  acute  pediatric  appointments  to  the  CAS,  allowing  pediatric 
personnel  to  spend  more  time  in  direct  patient  care  activities. 

Third,  the  system  can  be  tailored  to  patient  and  staff  needs 
by  decentralizing  the  appointment  workload  in  large  clinics. 

This  direct  support,  by  assigning  appointment  clerks  to  that 
clinic,  would  free  technician  and  nurse  time  for  other  direct 
patient  care  activities.  This  recommendation  should  increase 
patient  accessibility  to  hospital  staff,  reduce  the  overwhelming 
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number  of  telephone  calls  to  CAS,  and  allow  the  patient  to  book 
follow-up  appointments  prior  to  departing  the  clinic  area.  A  60 
day  pilot  test  of  this  decentralized  appointment  hub  concept 
began  on  20  June  1988  in  the  Internal  Medicine/Neurology 
clinic. 

Fourth,  further  study  of  patient  satisfaction  should  be 
undertaken.  Due  to  the  limitations  imposed  by  executive 
management,  the  actual  patients  surveyed  were  small  in  number 
(total  of  279).  In  addition,  the  survey  did  not  necessarily 
include  those  patients  in  the  geographical  catchment  area  who  do 
not  use  the  Air  Force  Academy  Hospital  for  their  patient  care 
needs.  While  this  small  group  does  not  allow  generalization  to 
the  patient  population  as  a  whole,  or  the  determination  of 
opinion  trends,  it  does  provide  a  clear  appreciation  for  popular 
concerns  among  the  patients. 

An  implementation  plan  (shown  in  appendix  Y)  was  included  to 
provide  an  orderly  decentralization  of  the  entire  hospital 
appointment  configuration,  should  the  pilot  test  be  successful. 
The  implementation  plan  outlines  the  ten  appointment  hubs,  which 
are  clinic  groups  in  a  decentralized  configuration.  These  hubs 
are: 

(1)  Internal  Medicine,  Neurology 

( 2 )  OB/GYN 

(3)  Family  Practice 

(4)  Mental  Health 

(5)  Cardiopulmonary 


(6)  Nuclear  Medicine 
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{ 7 )  Acute  Care 

( 8 )  Orth oped i cs ,  Podiatry 

(9)  Urology 

(10)  Pediatrics,  Nutrition,  Surgery,  Dermatology, 

Ophthalmology,  and  Optometry 

These  hubs  were  established  because  they  represent  logically 
similiar  clinical  areas,  similiar  appointments  or  procedures, 
are  physically  colocated,  and  have  workload  of  sufficient  volume 
to  earn  appointment  clerks  in  even  increments.  The 
implementation  plan  does  not  have  a  fixed  time-table,  and  ceun  be 
implemented  in  logical  groupings  as  management  and  staff 
desire. 

The  implementation  plan  contains  the  sequencing  and  cost 
data  associated  with  these  recommendations.  The  total  cost  to 
implement  these  recommendations  are  minimal.  The  hospital 
clinics  already  have  multiple  CRTs  in  the  clinic  areas,  desks, 
and  other  administrative  supplies.  These  items  are  currently 
used  by  the  clinic  personnel  to  support  acute  patient  telephone 
appointment  referrals.  In  addition,  no  additional  manpower  is 
required  to  implement  this  plan.  The  appointment  clerks  are 
merely  relocated  from  the  central  appointment  system  area,  or 
the  clinic  currently  desires  to  continue  using  technicians  to 
booked  appointments  due  to  the  nature  of  the  appointment  mix, 
complexity  of  procedures,  or  decisions  involved  with  specialized 
tests  performed. 

The  success  of  the  pilot  test  will  be  measured  at  the  end  of 
this  60  day  period  by  using  the  evaluation  plan  shown  in 
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appendix  Z.  The  evaluation  involves  measuring  four  main 
components  to  include:  patient  satisfaction  in  the 
decentralized  clinic,  patient  satisfaction  with  the  central 
appointment  system,  staff  satisfaction,  and  the  productivity  of 
the  clinic  health  care  providers.  This  plan  was  agreed  upon  by 
all  personnel  involved,  briefed  to  the  Hospital  Commemder,  and 
approved  by  the  hospital  Executive  Committee. 

The  first  component,  clinic  patient  satisfaction  will  be 
measured  using  the  questionnaire  shown  in  appendix  Z.  The 
second  element,  CAS  patient  satisfaction,  will  be  measured  using 
a  separate  outpatient  questionnaire  shown  in  appendix  Z.  The 
CAS  staff  and  the  clinic  staff  satisfaction  will  be  measured 
using  the  staff  questionnaire  developed  during  this  research 
(appendix  J).  The  last  component  involves  monitoring  the 
Internal  Medicine/Neurology  health  care  provider  productivity. 
This  will  be  done  by  comparing  clinic  provider  productivity 
prior  to  the  test  period,  with  productivity  during  the  test 
period. 

This  decentralized  test  involves  reassigning  one  full-time 
appointment  clerk  from  CAS  to  the  Internal  Medicine/Neurology 
clinic.  This  clinic  grouping  was  picked  for  this  pilot  test 
because ; 

(1)  The  recommendations  of  the  patients  and  staff  members  to 
increase  patient  accessibility,  free  technicieun  and  nurse 
time  for  other  direct  patient  care  activities,  and  tailor 
the  appointment  system  through  decentralization. 

(2)  The  clinics  are  co-located,  and  have  averaged  2,479 
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appointment  transactions  per  month  during  August  and 
September  1987  (see  appendix  M) .  This  workload  was  felt  to 
be  compatible  with  the  recommended  patient  contacts  per 
appointment  clerk  standard  of  approximately  2000  per  month 
(HSC  PAM  40-7  1986,  26). 

(3)  The  impact  on  the  CAS  would  be  minimal,  as  the  CAS 
should  see  a  26  percent  decrease  in  workload  and  only  a  20 
percent  decrease  in  staff.  The  CAS  would  have  four 
remaining  employees  to  handle  approximately  7, 100 
transactions,  well  within  the  recommended  standard  per  staff 
member. 

The  pilot  test  in  the  Internal  Medicine/Neurology  clinic  would 
use  a  total  of  two  telephone  lines  for  appointment  purposes. 

One  telephone  line  is  already  present  in  the  clinic  and  a  second 
will  be  relocated  from  the  CAS  area  at  a  cost  of  $180.00.  The 
$180.00  represents  the  total  tangible  cost  of  the  pilot  test  in 
the  Internal  Medicine/Neurology  clinic. 

The  results  and  recommendations  in  this  GRP  were  briefed  to 
the  Hospital  Commander  and  approved  by  the  hospital  Executive 
Committee  in  February  and  March  1988.  Hospital  personnel  were 
also  made  aware  of  the  various  findings  and  recommendations  of 
this  GRP.  These  changes  were  welcomed  by  the  hospital  staff. 
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DEFINITIONS 

Accessibility:  Establishing  contact  with  the  PAS.  Contact  is 
usually  made  by  telephone. 

Appointment  Transactions :  The  sum  total  of  the  appointment 
transactions  undertaken  by  an  appointment  clerk  in  the  normal 
course  of  duties.  These  transactions  include  booking, 
canceling,  scanning,  new  patient  registrations,  editing  old 
patient  registrations,  checking  patients  in  upon  arrival  at  a 
clinic,  and  logging  the  patient  as  a  walk-in. 

AQCESS :  Automated  Quality  of  Care  Evaluation  Support  System. 

An  automated  system  developed  by  TRIMIS  to  support  patient 
administration,  quality  assurance,  emergency  room,  patient 
appointing,  and  risk  managmenet. 

Availability:  Securing  an  appointment  after  contact  has  been 

made  with  the  PAS. 

A&SM:  Appointment  and  Schedule  Module.  Refers  to  the 

appointment  and  scheduling  module  in  the  AQCESS  system. 

CAS:  Centra]  Appointment  System.  A  system  for  making 

appointments  for  all  or  most  of  the  clinics  of  a  MTF  by  clerks 
who  are  in  one  location,  under  central  supervision. 
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Catchment  Area:  That  geographical  area  surrounding  each 
Uniformed  Services  MTF  that  constitutes  the  patient  service 
area.  The  catchment  areas  are  defined  by  ZIP  codes. 

CEA:  Cost-Effectiveness  Analysis.  Warner  and  Luce  define  it  as 

the  medical  practice  considered  to  be  "worth  the  expenditures  of 
resources. "  It  is  a  formal  analytical  technique  for  comparing 
the  consequences  of  alternative  uses  of  resources.  It  includes 
subjective  and  objective  analysis. 

CRT:  Cathode  Ray  Tube.  A  viewing  and  data  entry  device  used 

with  automated  appointment  systems. 

FY :  Fiscal  Year.  Refers  to  the  Department  of  Defense 

financial /budget  year  which  begins  1  October  and  ends  30 
September  of  the  following  year. 

HCP:  Health  Care  Provider.  These  include  physicians,  nurse 

practitioners,  physicians'  assistants,  physical  therapists, 
midwives,  optometrist,  audiologist,  nutritionist,  and  others 
providing  diagnostic  and  therapeutic  services  to  authorized 
health  care  beneficiaries. 

MTF:  Uniformed  Services  Medical  Treatment  Facility  -  any  of  the 

hospitals  or  clinics  owned  and  operated  by  the  Department  of 


Defense. 


D.  Shields  52 


NCO:  Non  Commissioned  Officer.  This  refers  to  the  enlisted 
members  of  the  Armed  Forces.  In  this  GRP  these  individuals  are 
primarily  the  medical  technicians  working  in  clinical  areas 
directly  supporting  patient  care  activities. 

Opportunity  Cost:  The  value  of  the  alternative  endeavors  that 
might  have  been  undertaken  with  the  same  resources  (Warner  and 
Luce,  1982). 

PAS:  Patient  Appointment  System.  An  appointment  system 
configuration  (manual  or  automated)  which  supports  appointment 
transactions. 

PAS  Personnel :  All  personnel  making  appointments  for  patients 
regardless  of  their  duty  assignment  and  job  title. 

SG:  Surgeon  General.  Refers  to  the  Air  Force  Surgeon  General, 

who  establishes  policy  and  «Tuidauice  for  the  Air  Force  Medical 
Service.  The  Air  Force  SG  is  located  at  Bolling  Air  Force  Base, 
Washington  D.C. 

TRIMIS:  Tri-Service  Medical  Information  System.  A  Department 

of  Defense  Tri-Service  organization  responsible  for  the 
automation  of  health  care  activities. 

USAF:  United  States  Air  Force.  A  component  of  the  Department 


of  Defense. 
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APPENDIX  B 

APPOINTMENT  CLERK  WORKLOAD  STATISTICS 
(AUGUST  1987) 


Workload  Analysis 
August  1987 
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APPENDIX  C 

APPOINTMENT  CLERK  WORKLOAD  STATISTICS 
(SEPTEMBER  1987) 


USAF  Academy  Hospital  Appointment  System 
Workload  Analysis 
September  1987 
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APPENDIX  D 

USAF  ACADEMY  AQCESS  EQUIPMENT  INVENTORY 


USAF  Academy  Hospital 
AQCESS  Equipment  Inventory 


Location 

*  of 

Terminals 

»  of 

Printers 

«  of 

Line  Printers 

«  of 

3X5  Card 
Printers 

Central  Appointments 

5 

1 

i 

1 

a 

Surgery 

1 

OB/GYN 

2 

Nutrition 

a 

Neurology 

Urology 

1 

Dermatology 

1 

Acute  Care 

1 

Family  Practice 

2 

Ortho/Pod 

2 

Peds/Well  Baby 

1 

Internal  Medicine 

2 

Nuclear  Medicine 

1 

Ophthalmology 

Optometry 

1 

Cardiopulmonary 

1 

Mental  Health 

1 

ENT 

2 

Medical  Systems 

2 

1 

Computer  Room 

1 

1 

1 

A  &  D 

2 

1 

1 

Quality  Assurance 

0 

** 

1 

Outpatient  Records 

1 

1 

Chief  Hospital  Services 

1 

Radiology 

1 

Emergency  Room 

1 

1 

Health  Promotions 

1 

a 

Physical  Therapy 

i 

MSA  Office 

1 

i 

1 

Administrator 

1 

Clinical  Records 

1 

Totals 

42 

8 

2 

1 
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APPENDIX  E 

USAF  ACADEMY  HOSPITAL  APPOINTMENT  SYSTEM 
TELEPHONE  EQUIPMENT  CONFIGURATION 
(18  NOV  87) 


USAF  Academy  Hospital  Appointment  Syst 
Staffing  and  Telephone  Configuration 


6 

0) 
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APPENDIX  F 

USAF  ACADEMY  HOSPITAL 
DECENTRALIZED  APPOINTMENT  STUDY 


(5  August  1987) 


STUDY  ON  DECENTRALIZATION  OF  THE  APPOINTMENT  SYSTEM 

5  August  1987 

Purpose  o-f  the  Study;  To  examine  the  topic  oi  decentralizing  the 
appointments  system  at  the  USAF  Academy  Hospital. 

1 .  Assumpt i ons! 

a.  The  primary  objective  o-f  decentralization  is  to  enhance  patient 
access  to,  and  sat  i  s-f  act  i  on  with,  the  appointment  system. 

b<  No  additional  manpower  authorizations  are  available  to  devcte 
to  the  appointment  system. 

c.  The  major  areas  to  be  covered  by  decentralized  appointment 
desks  are  the  medical  clinics,  the  surgical  clinics,  and  the  primary 
care  (-family  practice,  acute  care,  pediatrics)  clinics. 

d.  The  complexities  o-f  the  appointment  system  are  not  -fully 
understood  by  individuals  working  outside  the  system. 

e.  In  accordance  with  AFR  168-4,  the  appointment  system  will 
remain  the  responsibility  o-f  Patient  Affairs. 

2.  Factors  bearing  on  the  situation; 

a.  Patients  calling  in  to  the  central  appointments  desk  for  a 
specific  appointment  (i.e.,  medical,  surgical,  or  acute)  must  compete 
with  all  other  patients  to  get  through. 

b.  Many  patients  schedule  more  than  one  appointment  when  they  call 
the  central  appointments  desk. 

c.  The  AQCESS  system  brings  the  various  clinics  and  services 
closer  to  the  appointment  process  than  was  previously  possible. 

d.  The  AQCESS  system  does  not  impact  significantly  on  the  final 
decision.  System  terminals  can  remain  in  place,  or  decentralized  with 
relative  ease. 

e.  Decentralization  of  the  appointment  system  will  provide 
patients  with  double  access  to  the  system — both  walk-up  and  telephone. 

f.  Decentralization  will  require  additional  telephone  lines  and 
telephone  call  sequencers. 

3 .  Positive  Aspects  of  Decentralization: 

a.  Appointment  clerks  should  enjoy  a  better  rapport  with  the 
providers  and  clinic  staff  they  serve.  Appointments  clerks  should  be 
better  tuned  to  unique  practices  and  'olicies  in  the  various  clinics. 

b.  Patients  should  be  able  to  make  follovj-up  appointments  before 
leaving  the  clinical  areas. 


c.  Training  time  of  appointment  clerks  may  be  reduced  as  they  will 
have  a  ‘narrower*  area  to  learn. 

d.  The  presence  of  appointment  clerks  may  release  clinic  personnel 
for  more  direct  patient  care  duties. 

4.  Neoative  Aspects  of  Decentralization; 

a.  The  genuinely  synergistic  effect  of  a  centralized  appointment 
system  would  be  lost.  Currently,  the  various  appointment  clerks  can 
provide  immediate  back-up  for  one  another.  Decentralizing  the 
appointment  system  would  leave  an  idle  surgery  appointments  clerk  unable 
to  assist  an  over-taxed  medicine  appointments  clerk. 

b.  Trained  appointment  clerks  will  not  be  readily  available  to 
assist  newly  hired  appointment  clerks.  New  clerks  will  depend  on  a 
roving  supervisor  and/or  clinic  personnel  for  training  and  assistance. 

c.  It  will  become  much  more  difficult  to  cover  employee  absences. 

A  supervisor  who  is  covering  for  an  appointment  clerk  on  leave,  or 
filling  a  vacant  position,  may  be  faced  with  an  absent  clerk  at  another 
desk.  Clinic  personnel,  who  must  be  fully  trained  on  the  system,  will 
be  required  to  pick  up  the  slack.  This  problem  would  be  greatly 
compounded  on  extremely  high  volume  days,  e.g.,  days  when  appointments 
are  opened  for  the  entire  following  month.  Patient  service  within  the 
clinic  would  decrease  as  clinic  personnel  are  taxed  to  support  the 
appointment  system,  and  waiting  time  for  call-in  patients  would  no  doubt 
increase  due  to  the  inefficiencies  of  the  temporary  clerk. 

d.  Patients  needing  appointments  is  different  specialties  may  need 
to  make  additional  phone  calls. 

e.  Patients  will  be  able  to  walk-up  to  the  appointments  desks.  A 
patient  present  in  person  will  generally  command  more  attention  than  a 
patient  on  the  phone.  There  is  the  potential  for  excessively  long 
telephone  waiting  times  to  develop. 

f.  Appointment  clerks  will  lose  their  familiarity  with  referral 
practices  outside  their  specialty  area. 

g.  Appointment  clerks  available  to  clinic  personnel  will  no  doubt 
be  tasked  to  accomplish  duties  outside  their  appointments 
responsibilities  <i.e.,  receptionist,  typing,  distribution,  e\c).  This 
will  be  especially  true  in  the  absence  of  the  service  secretary.  While 
it  is  prudent  to  make  effective  use  of  idle  appointment  clerk  time, 
there  appears  to  be  real  potential  for  appointment  service  to  decline 
because  of  these  additional  demanos. 

5 .  Conclusi ons! 


The  patient  service  provided  by  the  central  appointments  desk  is 
highly  satisfactc  The  sequencer  system  generates  a  daily  report 
which  lists  total  number  of  calls,  average  waiting  time  on  the 
sequencer,  and  average  time  before  the  patient  abanoons  the  call.  A 


large  sample  O'#  these  reports  was  analyzed  ■for  the  annual  appraisal  o-f 
the  appointment  system.  Average  hold  time  for  patients  was  57  seconds, 
a  very  acceptable  ■figure. 


The  undersigned  see  no  true  potential  for  improving  patient  service 
by  decentralization  of  the  appointment  system.  In  fact,  the 
distractions  assoc i ated  wi th  placing  the  appointment  clerk  in  the 
clinic,  coupled  with  the  loss  of  the  synergistic  effect  of  the 
centralized  system,  may  impact  quite  negatively  on  patient  service.  The 
addition  of  administrative  personnel  to  the  clinic  areas  is  an  excellent 
move  which  will  undoubtedly  improve  clinic  administration.  Assigning 
appointment  clerks  to  the  clinic  areas  will  make  the  service  secretaries 
appointment  clerks,  and  the  appointment  clerks  service  secretaries,  to 


the  detriment  of  both  areas.  Ue  recommend  that  no  changes  be  made  to 
the  current  appointment  system.  ^ 


,52.  i 


KEVIN  A.  POLLARD,  Capt,  USAF,  MSC 
Director,  Patient  Affairs 


DIAN  L.  ATKINS,  Ma j ,  USAF,  NC 
Nursing  Supervisor 
Ambulatory  Care  Services 
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APPENDIX  G 

CALL  SEQUENCER  MANAGEMENT  SYSTEM  REPORT 


CALL  SEQUENCER  MANAGEMENT  SYSTEM 
AEC  MODEL  1101  REPORTS 
2-17  DECEHSER  19B7i 
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APPENDIX  H 

1987  AIR  FORCE  HEALTH  CARE  SURVEY 


This  survey  was  administered  to  279  patients  chosen  at  random 
from  outpatient  clinics  throughout  the  hospital  during  December 
1987  and  January  1988. 

Questions  #1,  iJ31  and  the  written  comments  were  used  to 

provide  a  descriptive  measure  of  patient  satisfaction  with  the 
appointment  system.  This  is  not  necessarily  a  statistically 
raaidom  sampling,  and  the  survey  instrument  may  not  be 
jatistically  validated. 


DEPAFTMENT  OF  THE  AIR  FORCE 
HEADQUARTERS  UNITED  STATES  AIR  FORCE 
BOLLING  AFB  DC  20332-61  B8 


3  AUG  1987 


Dear  Air  Force  Health  Care  Beneficiary 

It  Is  my  goal  that  you  and  your  family  receive  the  highest  quality 
care  possible  and  that  your  care  Is  delivered  In  a  compassionate 
manner.  One  of  the  most  effective  ways  we  have  of  obtaining 
Information  concerning  the  services  we  provide  Is  through  you. 
Thus,  you  can  help  by  telling  us  how  you  feel  about  our  health 
del  I  very  system . 

This  survey  will  take  only  five  to  ten  minutes  to  complete.  The 
Information  provided  will  help  us  pinpoint  problem  areas  and  allow 
us  to  make  our  services  better  In  the  future.  Participation  In 
the  survey  Is  voluntary.  No  penalty  will  be  Imposed  for  failure 
to  respond  to  any  or  all  questions.  However,  your  participation 
will  contribute  to  a  better  understanding  of  how  we  deliver 
services.  Your  response,  after  being  aggregated  with  those  of 
ether  respondents,  will  be  considered  by  officials  who  make  health 
care  policy  decisions. 

We  are  extremely  Interested  In  your  opinions  both  positive  and 
negative.  Please  read  each  question  carefully,  keeping  In  mind 
the  health  care  you  are  now  receiving.  Please  answer  all  of  the 
questions.  Some  statements  look  similar  to  others,  but  each 
statement  Is  different.  You  should  answer  each  statement  by 
itself.  There  are  no  right  or  wrong  answers. 

Please  take  the  time  to  complete  and  return  the  survey.  I  thank 
you  In  advance  for  helping  us  evaluate  our  health  delivery  system. 

S I ncer e I y  ✓ 

MURPHY  AT^CHESNEY  /  j 
Lieutenant  General,  ICS^,  MC 
The  Surgeon  General  ' 


1  Atch 
Survey 


UNITED  STATES  AIR  FORCE 


SEPTEMBER  18,1947 


HEALTH  CARE 
SURVEY 


Please  mark  your  answers  on  the  attached  answer  sheet  using  a  soft 
lead  pencil.  Please  do  not  use  pen  or  Ink. 


PERSONAL  DATA 

1.  What  Is  your  beneficiary  category? 

A.  Act  I ve  Duty 

B.  Dependent  of  active  duty 

C.  Retiree 

D.  Dependent  of  retiree  or  deceased  member 

E.  Other 

2.  What  Is  your  sex? 

A.  Male 

B.  Female 


FACILITY  INFORMATION 

3.  Do  you  receive  the  majority  of  your  health  care  from  an  Air  Force  medical 
treatment  facility  (AF  MTFJ? 

A.  Yes 

B.  No 

4.  If  you  do  not  receive  the  majority  of  your  health  care  from  an  Air  Force 
medical  treatment  facility,  which  one  of  the  following  best  explains  why 
not? 


A.  Not  appi  Icable 

B.  The  AF  MTF  lacks  the  services  1  need 

C.  The  AF  MTF  Is  not  conveniently  located 

D.  I  am  not  treated  courteously 

E.  Providers  are  not  thorough  In  their  examinations 

F.  Providers  don't  explain  my  problems  to  my  satisfaction 

G.  It  seems  I  see  a  different  provider  each  time  I  have  an  appointment 

H.  My  schedule  conflicts  with  the  times  the  MTF  offers  care 

I.  It  Is  too  difficult  to  get  an  appointment 

5.  If  you  do  not  receive  the  majority  of  your  health  care  from  an  Air  Force 
medical  treatment  facility,  which  one  of  the  following  do  you  use? 

A.  Not  appi Icable 

B.  CHAMPUS 

C.  Private  Insurance 

D.  Employee  programs  (e.g..  Health  Maintenance  Organization) 

E.  Other  federal  facility  (e.g.,  another  military  facility  or  VA) 

F.  I  pay  for  the  care  myself 
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Pleas®  answer  all  of  the  remaining  questions  as  they  pertain  to 
TH I S  Air  Force  Medical  Treatment  Facility. 


GENERAL  OPINIONS 

6.  How  would  you  rate  the  overall  quality  of  services  you  have  received 
within  the  last  year? 

A.  Poor 

B .  Fair 

C .  Good 

D.  Exce I  lent 

7.  If  an  authorized  user  was  In  need  of  health  care,  would  you  recommend  this 
AF  MTF? 

A.  No ,  def In  1 te I y  not 

B.  No.  1  don't  think  so 

C.  Yes,  I  think  so 

D.  Yes,  definitely 

8.  How  satisfied  are  you  with  the  care  you  have  received? 

A.  Quite  dissat Isf led 

B.  Mildly  dissat isf led 

C.  Most ly  sat Isf led 

D.  Very  satisfied 


GENERAL  OPINIONS  ABOUT  HEALTH  CARE 

For  questions  9  -  25,  please  use  the  scale  below  to  Indicate  how  much  you  agree 
or  disagree  with  the  following  statements.  The  term  "health  care  provider" 
refers  to  any  Individual  who  provides  health  care.  For  example,  this  Individ¬ 
ual  may  be  a  physician,  physician  assistant,  psychologist,  nurse  practitioner, 
or  medical  technician. 

A  -  B  -  C  -  D  -  E 

Highly  Agree  Neither  Agree  Disagree  Highly 

Agree  Nor  Disagree  Disagree 


9.  The  health  care  provider  Is  very  careful  to  check  everything  when  examin¬ 
ing  me. 

10.  1  think  this  medical  treatment  facility  has  everything  needed  to  provide 
complete  treatment. 

11.  The  health  care  provider  Is  polite. 

12.  I  hardly  ever  see  the  same  provider  when  I  go  for  medical  care. 

13.  It  takes  me  a  long  time  to  get  to  the  place  where  I  receive  medical  care. 
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Highly  Agree  Neither  Agree  Disagree  Highly 

Agree  Nor  Disagree  Disagree 

14.  The  medical  problems  I've  had  In  the  past  are  Ignored  when  I  seek  care  for 
new  medical  problems. 

15.  The  health  care  provider  Is  warm  and  friendly. 

16.  The  health  care  provider  Isn't  as  thorough  as  he/she  should  be. 

17.  In  an  emergency,  It's  hard  to  get  medical  care  quickly. 

18.  Air  Force  medical  treatment  facilities  are  very  conveniently  located. 

19.  The  health  care  provider  does  his/her  best  to  keep  me  from  worrying. 

20.  1  see  the  same  health  provider  Just  about  every  time  I  go  for  medical 
care . 

21.  Health  care  providers  cause  some  people  to  worry  a  lot  because  they  don't 
explain  medical  problems  to  them. 

22.  Generally,  the  amount  of  time  I  have  had  to  wait  (after  arriving  and 
before  seeing  the  health  care  provider)  during  the  last  12  months  has  been 
reasonable. 

23.  Hours  available  to  get  health  care  are  good  for  most  people. 

24.  This  medical  facility  lacks  some  things  needed  to  provide  complete  medical 
care . 

25.  Parking  Is  a  problem. 

26.  I  often  have  to  repeat  tests  or  answer  the  same  questions  because  I 
constantly  see  different  providers. 

PATIENT  PERCEPTIONS  OF  SPECIFIC  HOSPITAL/CLINIC  SERVICES 

Using  the  scale  below,  please  tell  us  how  satisfied  you  are  with  the  following 
ser V  I ces  : 

A  -  B  - C  -  D  -  E 

Very  Very 

Satisfied  Satisfied  Neutral  Dissatisfied  Dissatisfied 

27.  X-ray 

28.  Pharmacy 
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A 


B  - C 


D 


E 


Very 

Satisfied 


Satisfied  Neutral 


D 1 ssat I sf 1 ed 


Very 

D I ssat I sf I ed 


29.  Laboratory 

30.  Facility  appearance 

31.  Appointment  system 

32.  Medical  records  section 

33.  Dental  cl Inic 

34.  Support  (enlisted)  personnel  In  the  clinics 

35.  Health  Benefits  Advisor 


WRITTEN  COMMENTS 


Please  use  the  space  below  to  tell  us  what  you  think  about  the 
providing  medical  care.  Your  comments  will  be  compiled  and  wl 
by  the  executive  management  of  this  medical  treatment  facility 
decisions  for  change. 


way  we  are 
1  be  used 
In  making 


THANK  YOU  FOR  PARTICIPATING  IN  THIS  SURVEY 


-  4  - 


•  oj  oovtMncfirr  pfumwo  omct  \w  •  iao-%o  *  ns/eooao 
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APPENDIX  I 

APPOINTMENTS  STRUCTURED  INTERVIEW  QUESTIONNAIRE 

(Pre-test) 


SOURCE:  Alexander  1977,  39-42. 

Badget  1987,  Interview. 
Clover  1987,  Interview. 
Raiha  1985,  87-90. 
Stuart  1973,  Appendix  2 
USAOECS  1983,  55-63. 


USAF  Academy  Hospital  Appointment  Svstem 
Staff  Interview  Survey  Cues t i onna i r e 


? UHSOSE :  This  s^udv  :s  bein?  conducted  to  determine  how  you  feel 
about  the  system  used  for  making  outpatient  appointments  at  the 
USAF  Academy  Hospital.  It  should  take  you  approximately  5 
minutes  to  complete  this  survey.  The  results  of  this  survey  may 
have  a  significant  impact  on  future  po 1 i cy / gui dance  and 
configuration  of  the  appointment  system. 

All  answers  to  the  questions  should  be  based  on  your  experience 
with  the  appointments  system  at  the  USAF  Academy  Hospital  and  not 
any  other  experience  you  may  have  had  with  other  appointment 
systems.  Your  answers  will  be  combined  with  those  of  other  staff 
members ,  and  presented  for  analysis  at  the  completion  of  the 
survey . 

Your  cooperation  in  completing  this  quest i onnai re  will  be  greatly 
appreciated  and  will  provide  valuable  information  which  may  be 
used  to  make  the  outpatient  appointment  system  serve  you  better. 


LOWELL  A.  SCHUKNZCHT.  JR.,  Col,  USAF,  MC 
Command  Surgeon/ Kosp i tal  Commander 


FLEAS-  TURN  TO 
COMPLETING  THE 


THE  NEXT  RAGE  AND  FOLLOW  THE 
QUESTIONNAIRE 


:::sTRucTiONs  for 


PAGE  1 


1.  Please  place  an  ‘X'  in  vhe  box  in  front  of  the  statement 
which  best  describes  your  current  status: 


(  )  Physician 

(  )  Optome tr i s t/Oph thal mo  1 o| 1 s t/Nutr 1 1 1 oni 3 1 / Aud 1 o 1 og 1 3 

(  )  Nurse  Clinician 

(  )  Clinic  NCO 

(  )  Appointment  C 1 erk/ Super v i sor 

(  )  Department  Manager  i Non - c i i n i ca 1 ) 

(  )  Executive  Management 


‘2.  How  long  have  you  been  in  your  present  position  at 
Academy  Hospital’ 


the  USA? 


(  )  Less  than  o  months 

(  )  5  months  to  11  months 

(  '  i  to  3  years 

(  )  More  than  3  years 


PLEASE  rUHK  TO  THE  NEXT  PAGE  AND  FOLLOW  THE  INSTRUCTIONS  FOR 
COMPLETING  THE  CUESTIONNAIRE 


PAGE  2 


Please  circle  the  number  which  best  describes  your  feelings  about  each  of 
issues  related  to  the  way  In  which  the  appointment  system  operates.  High 
satisfaction  and  lower  numbers  indicate  dissatisfaction .  Please  consider 
Academy  Hospital  appointment  system  and  not  any  other  system  you  have  had 


the  following 
numbers  indicate 
only  the  USAF 
experience  with. 


Very 

Satisf led 


Satisf 1 ed 


Di 


Neither 
Satisf led/ 
ssat 1 s  f i ed 


Very 

Li ssat isf led  Dissatisfied 


3.  Your  overall  opinion  543  2 

of  the  appointment  system 
used  to  make  appointments. 


4.  Your  ability  to  obtain  5 

information  (patient  and 
schedules)  from  the 
appointment  system. 

5.  How  satisfied  are  you  5 

that  the  central  appoint¬ 
ment  clerk  matches  the 

patient  with  the  proper 
clinic. 

6.  Your  overall  opinion  5 

on  the  responsi veness  of 

the  appointment  system 
to  your  needs. 

7.  How  satisfied  are  you  5 

with  your  ability  to  contact 

the  cs.ttral  appointmen. 
clerk  when  you  need  to. 

8.  How  satisfied  are  you  5 

with  the  number  of  appoint¬ 
ment  scheduling  people  in 

your  area. 

9.  How  satisfied  would  you  5 
he  if  all  appointments  were 

made  :n  the  clinic  area 
(given  no  additional  staffing). 

’.0.  H'w  satisfied  would  vou  5 
he  ::  all  appointments  were 
mace  in  the  clinic  area 
'given  one  additional  full¬ 
time  appointment  clerk). 


4 


4 


4 


4 


4 


A 


4 


3 


3 


3 


3 


PLEASE  Tl'P.h'  ?0 


AND  CC.VPLETE 


2 


2 


2 


2 


2 


C.'.'NA 


PAGE  3 


11.  If  you  could  change  anything  about  the  appointment  system,  what  would  it  be’ 


12.  How  would  one  additional  full-time  appointment  clerk  affect  the  patient  care  provided 
in  vour  area’ 


ArTEP  COVlPLETIIiG  THIS  PAGE  PLEASE  PETUP.N  THE  SUEVEY  TO  THE  SUHVEY03 


*  » 

*  THAN'X  YOU  VERY  MUCH  "OH  YOUH  TIME  • 

»  :k  completing  this  survey 
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APPENDIX  J 

APPOINTMENTS  STRUCTURED  INTERVIEW  QUESTIONNAIRE 

(Post-test) 


SOURCE:  Alexander  1977,  39-42. 

Badget  1987,  Interview. 
Clover  1987,  Interview. 
Raiha  1985,  87-90. 

Stuart  1973,  Append i''  2. 


USAOECS  1983,  5.  _ 


PURPOSE :  This  study  is  being  conducted  to  determine  how  you  feel 

about  the  system  used  for  making  outpatient  appointments  at  T.he 
USAF  Academy  Hospital.  It  should  take  you  approximately  5 
minutes  to  complete  this  survey.  The  results  of  this  survey  may 
have  a  significant  impact  on  future  pol icy/guidance  and 
configuration  of  the  appointment  system. 

All  answers  to  the  questions  should  be  based  on  your  experience 
with  the  appointment  system  at  the  USAF  Academy  Hospital  and  not 
any  other  experience  you  may  have  had  with  other  appointment 
systems.  Your  answers  will  be  combined  with  those  of  other  staff 
members,  and  presented  for  analysis  at  the  completion  of  the 
survey . 

Your  cooperation  in  completing  this  questionnaire  will  be  greatly 
appreciated  and  will  provide  valuable  information  which  may  be 
used  to  make  the  outpatient  appointment  system  serve  you  better. 


LOWELL  A.  SCHUKNECHT,  JR.,  Col,  USAF.  MC 
Command  Surgeon/Hospital  Commander 


PLEASE  TURN  TO  THE  NEXT  PAGE  AND  FOLLOW  THE  INSTRUCTIONS  FOR 
COMPLETING  THE  QUESTIONNAIRE 


PAGE  2 


1.  Please  place  an  ‘X*  in  the  box  in  front  of  the  statement  which  best  describes  your 
current  status: 

(  )  Physician 

(  )  Optometrist/Nutritionist/Audiologist 

(  )  Nurse  Clinician 

(  )  Clinic  NCOIC 

(  )  Appointment  Clerk/Supervisor 

(  )  Department  Manager  (Non-cl inical ) 

(  )  Executive  Management 

(  )  Other  -  Please  Specify: 


2.  How  long  have  you  been  in  your  present  position  at  the  USAF  Academy  Hospital'? 

(  )  Less  than  6  months 

(  )  6  months  to  1 1  months 

(  )  1  to  3  years 

{  )  More  than  3  years 


3.  In  what  clinic  or  appointment  area  do  you  serve  in  your  present  position? 


(  )  Central  Appointments 

(  )  Surgery 

(  )  OB/Gyn 

(  )  Nutrition 

(  )  Neurology 

{  )  Dermatology 

(  )  Acute  Care 

(  )  Family  Practice 

(  )  Ortho/Podiatry 

(  )  Pediatrics 

(  )  Internal  Medicine 


(  )  Nuclear  Medicine 

(  )  Ophthalmology 

(  )  Optometry 

(  )  Cardiopulmonary 

(  )  Mental  Health 

(  )  ENT 

(  )  Other  -  Please  Specify: 


(  )  Not  applicable  -  I  do  no 

work  in  a  clinic  or 
appointment  area 
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lease  circle  the  number  which  best  describes  your  feel  ings  about  each  of  the  following  issues 
■elated  to  the  way  in  which  the  appointment  system  operates.  High  numbers  indicate  satisfaction 
ind  lower  numbers  indicate  dissatisfaction.  Please  consider  only  the  USAF  Academy  Hospital 
appointment  system  and  not  any  other  system  you  have  had  experience  with. 


Not 

Appl icable 
N/A 

Very 

Sat  1  s  f  -i  ed 

Sat  1 s 1  led 

Ne i ther 

Sat i s  f 1 ed/ 
Dissatisf ied 

Dissatisf ied 

Very 

Dissatisf led 

Your  ability  to 
ibtain  patient  and 
chedule  information 
rom  the  appointment 
■ys  tern’ 

N/A 

5 

4 

3 

2 

1 

.  How  satisfied  are 
ou  that  the  central 
.ppointment  clerk 
latches  the  patient 
'ith  the  proper 
.ppointment  slot? 

N/A 

5 

4 

3 

2 

1 

How  satisfied  are 
ou  with  your  ability 
0  contact  the 
•entral  appointment 
lerk  when  you  need 

N/A 

5 

4 

3 

2 

1 

.  How  satisfied  are 
ou  with  the  number 
f  appointment 
cheduling  people 
n  your  area’ 

N/A 

5 

4 

3 

2 

1 

.  How  sat  1 s  f i ed 
.’ould  you  be  if  all 
ppointments  were 
.ade  in  the  clinic 
rea  (given  no 
dditional  staffing)’ 

N/A 

5 

4 

3 

2 

1 

.  Your  overall 

N/A 

5 

4 

3 

2 

1 

pinion  of  the 
ppointment  system 
sed  to  make 
ppointments"’ 


PLEASE  TURN  TO  THE  NEXT  PAGE  AND  COMPLETE  THE  QUESTIONNAIRE 
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10.  If  you  could  change  anything  about  the  appointment  system,  what 
would  it  be"? 


11.  How  would  one  additional  full-time  appointment  clerk  affect  the 
patient  care  provided  in  your  area? 


AFTER  COMPLETING  THIS  PAGE  PLEASE  RETURN  THE  SURVEY  TO  MAJOR  SHIELDS 


THANK  YOU  VERY  MUCH  FOR  YOUR  TIME  * 

IN  COMPLETING  THIS  SURVEY  » 

« 
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APPENDIX  K 

HOSPITAL  REGULATION  168-6  (13  July  1987) 
HOSPITAL  APPOINTMENT  SYSTEM 


OCPARTN£MT  Of  THE  AIR  FORCE 
He«d^u«rters  U$  Air  Force  Academ/ 

U$AF  Acddem/  HospUdI 
Colorado  Srpin^s  CO  00d40-&300 

Hedical  Administration 

HOSPITAL  APPOINTMENT  SYSTEM 

This  reyulation  establishes  policies  and  procedures  for  USAF  Academy  Hospital  personnel  in  operating  the 
hospital  appointment  system,  particularly  the  Automated  Quality  of  Care  Evaluation  Support  System  (AQCESSj 
Appointment  Scheduling  Module  (ASM). 

1.  REFERENCE.  HR  700-1,  Hospital  Information  Systems. 

2.  RESPONSIBILITIES. 

a.  The  Hedical  Systems  Office  (SGS)  is  responsible  for  planning,  preparation,  installation, 
implementation,  maintenance  (to  include  softMare  and  harouare)  and  traininy  on  automated  appointment  systems. 

b.  Clinic  chiefs  and/or  NCOlCs  will  be  responsible  for  operation  of  automated  appointment  systems  within 
their  respective  clinics/services.  These  responsibilities  include: 

(1)  Site  preparation  within  the  clinic. 

(2)  Scheduling  clinic  personnel  for  required  training. 

(3)  Developing,  loading  and  updating  provider  schedules  (templates). 

(4)  Operation  of  the  system  according  to  directives  and  prescribed  standards. 

(5)  Ensuring  that  sufficient  personnel  are  trained  for  continuous  proper  operation  of  the  automated 
appointment  system  within  the  clinic. 

(6)  Advising  the  central  appointment  desk  (CAD)  supervisor  of  all  changes  at  the  clinic/service  level 
that  Impact  on  appointments  controlled  and  filled  by  the  CAD. 

c.  The  director.  Patient  Affairs,  is  responsible  for  operating  the  hospital’s  central  appointment  desk. 

3.  PROCEDURES. 

a.  Appointment  schedules  for  a  given  month  will  generally  oe  opened  on  the  second  working  Friday  of  the 
preceding  month.  (EXAMPLE:  Appointments  for  the  month  of  June  will  be  opened  on  the  second  working  Friday 
of  May).  The  precise  date  will  be  publicized  by  the  CAD  well  in  advance. 

b.  Provider  templates  will  be  constructed  by  tbe  appropriate  clinic,  and  forwarded  to  SGH  for  approval 

prior  to  loading  them  into  the  automated  appointment  system.  Templates  will  not  be  changed  or  altered  without 

the  prior  approval  of  SGH.  To  prevent  Inconvenience  to  patients,  templates  should  not  be  altered  within  five 

(5)  working  days  on  a  major  appointment  opening  date  (  see  paragraph  2. a.  above). 

c.  Provider  schedules  for  a  given  month  must  be  loaded  into  the  automated  appointment  system  at  least  two 

(2)  working  days  before  the  day  they  are  opened.  Advance  loading  allows  review  of  the  schedules  and  correc¬ 
tion  of  any  problems.  Individual  clinics  are  responsible  for  loading  schedules.  CAO  does  not  have  the 
required  access  codes,  and  cannot  load  schedules. 

d.  Clinics  may  control  all,  some,  or  no  appointments  at  the  clinic  level.  The  CAD  will  control  and  book 
all  appointments  not  reserved  by  the  various  clinics.  Clinics  that  retain  control  over  some  or  all  of  their 
appointments  must  clearly  delineate  those  appointments  to  the  CAD. 

e.  Whenever  possible,  the  various  codes  used  to  identify  types  of  appointments,  such  as  routine, 
follow-up,  physical  exam,  will  be  standardized  for  all  clinics. 


Supersedes  HR  16B-6,  23  June  1983(See  signature  page  for  Summary  of  Changes) 
No  of  Printed  Pages:  2 
DPR:  SGR  (Capt  Pollard) 

Approved  by:  Col  Robert  0.  lott  f** 
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HR  168-6 


,  Jut/  1987 


f.  Clinic  4ppoinuientc  «iU  not  be  cancelled  by  the  provider  Mithout  sufficient  justtfu  jn.  sucn 

eaergency  leave  or  bospitalization.  AH  schedule  changes  or  cancellations  must  be  approved  .CH  at  the 

earliest  possible  point.  All  changes  will  have  approval  of  the  service  chief  prior  to  subm'i  ,n  to  SGH. 

y.  The  CAp  will  not  accept  requests  for  cancellations  or  changes  from  providers  or  clii  personnel 
without  an  indication  that  SGH  concurs. 


h.  Cancellation  of  appointments,  when  directed  by  SG.  SGH  or  SGA.  is  the  responsibility  of  tne  CAD. 

This  applies  onl/  to  appointments  originally  boohed  by  the  CAD.  Clinic  personnel  may  be  tasted  to  perfonti 
this  function  if  short  notice  or  excessive  workload  leaves  the  CAD  unable  to  nuke  the  cancellations.  Such  a 
requirement  should  oe  coordinated  with  SGA,  SGH,  SGHC  and  SGR.  When  the  hospital  initiates  cancellation, 
patients  will  be  rescheduled  simultaneously.  Patients  will  not  be  expected  to  reschedule  their  own 
appointments. 


OF/3  Cl AL 


C_  y 

HAT, HEW  J.  KELl/.'-rMSyl,  iSAF 
Chief,  Personnel’ 4  Admin  Services 


LOWELL  A.  SCHUKHECHT,  JR.,  Col,  USAF,  HSC 
Hospital  Commander 


Summary  of  Changes 

This  regulation  has  been  completely  revised 
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APPENDIX  L 

USAF  ACADEMY  HOSPITAL  CENTRAL  APPOINTMENT  SYSTEM 
NON  AQCESS  WORKLOAD  SUMMARY 
(9-20  November  1987  Survey) 


USAF  Academy  Itospit.ai  Central  Appointment  System 
Non  ACCESS  Workload  Summary 
(7  -  20  November  1987  Survey)  * 
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APPENDIX  M 

USAF  ACADEMY  HOSPITAL  APPOINTMENT  SYSTEM 
AVERAGE  CLINIC/AREA  TRANSACTION  WORKLOAD 


( Summary ) 


USAF  Academy  Hospital  Appointment  System 
Average  Clinic/Area  Transaction  Workload 


Average  » 

Average* 

Average  » 

#  of  Total 

%  of  Total 

Mon  th 1 y 

Hospi tal 

Hospi tal 

Patient 

Appointment 

Appointment 

Cl inic/Area 

Visits 

Transactions 

Transactions 

Central  Appointments 

N/A 

9558 

32 . 93% 

Surgery 

466 

732 

2.52% 

CB/GYN 

1460 . 5 

2052 

6 . 97% 

Nutr i tion 

430 . 5 

940 . 5 

3.11% 

Neurology 

166 

305 

1 . 04% 

Urology  and  ** 

231 

370 . 5 

1  .  27% 

Dermatology 

492 

523 

1 . 77% 

Acute  Care  ** 

709 . 5 

1  265 . 5 

4 . 28% 

Family  Practice 

424  1 

4850 

16 . 48% 

Ortho/Podiatry  ** 

1  109 

1993 . 5 

6 . 80% 

Peds/Well  Baby 

1225 

1609 

5 . 4  0% 

Internal  Medicine 

1706 . 5 

2174 

7 . 29% 

Nuclear  Medicine 

133 . 5 

195 

.  66% 

Ophthalmology 

228.5 

290 . 5 

1 . 02% 

Optometry 

289 

242 . 5 

.  8  5% 

Cardiopulmonary 

488 

907 . 5 

3  .  12% 

Mental  Health  ** 

370 

784 

2 . 56% 

ENT 

527 

581 

1 . 97% 

Hospital  Total 

14273 

27324 . 02 

100 . 04% 

Source:  -  USAF  Academy  Hospital  AQCESS  Command  Clinic  Performance 
RECAP  Report,  August  and  September  1987 

-  USAF  Academy  Hospital  Report  of  Patients,  AF  Form  235, 
August  and  September  1987 

-  USAF  Academy  Hospital  AQCESS  Clerk  Workload,  August  and 
September  1987 


*  Based  on  appointment  system  data  obtained  from  AQCESS  and  Report 
of  Patients  [(Aug  37  +  Sep  87)/2] 

**  Clinic  books  100%  of  their  own  appointments 

Does  not  include  the  following  areas  not  using  A''CESS;  Physical 
Therapy,  Cadet  Clinic,  Allergy  Clinic,  and  the  Emergency  Clinic 
Clinic  closed  as  of  20  Nov  87  -  lack  of  physician  staffing 
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APPENDIX  N 

CENTRAL  APPOINTMENT  SYSTEM  ADVANTAGES 


SOURCE;  Alexander  1977,  17. 

Brandler  1983,  29. 

Dickinson  1979,  225. 

Fishbacker  &  Robertson  1986,  283. 
Madden  1976,  48. 

O’Keefe  1985.  709. 

Palmer,  Wilson  Hubble  1987,  355. 
Pollard  &  Atkins  1987,  1-2. 
Ratzer,  Fletcher  1978,  167. 
Reisman,  Silva,  Mantell  1978,  50. 
Singer,  Rossfeld,  Hall  1976,  156. 
Stuart  1973,  60-68  &  100. 

Stuart  1976,  392. 

Woerly  1986,  9. 


Advantages 


1.  Ceniralized  control  and  monitoring  -  easily  shows  bottlenecks 
or  problem  areas  in  service. 

2.  Standardized  managemen t / wor k 1 oad/pr oduc t i v i ty  reporting  is 
eas 1 er . 

3.  A  single  telephone  number  for  patients  to  call  and  book  all 
appointments  -  ease  of  access. 

4.  All  appointment  clerks  have  the  capability  of  making  multiple 
clinic  appointments. 

5.  Telephone  support  and  monitoring  equipment  is  more  easily 
affordable  (calls  on  hold,  music,  sequencer,  management  reports). 

j .  Zconomics  of  scale  -  can  cake  advancage  of  mechan i zac i on  that 
would  not  be  cost-effective  on  a  decentralized  basis. 

7.  Ability  to  handle  peak  workload  requirements  of  one  clinic 
due  to  increased  numbers  of  co-located  personnel. 

8.  Frees  clinic  receptionists,  nurses,  and  other  personnel  from 
the  need  to  be  appointment  clerks, 

9.  Decreases  the  noise  by  telephone  and  filing  equipment  in  the 
clinic  area, 

10.  .Availability  of  full-time  appointment  personnel  to  answer 
telephones  . 

11.  Availability  of  well-trained  appointment  supervisor  to  handle 
difficult,  often  hostile  patients. 

12.  A  central  source  of  hospital  information  to  the  patient. 

13.  Multiple  clerks  provide  service  in  depth,  allowing  the  phones 
to  be  answered  when  one  or  more  appointment  clerks  are  absent, 

14.  Allows  a  separate  telephone  line  to  be  prioritized  for 
patients  calling  long  distance. 
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APPENDIX  O 

CENTRAL  APPOINTMENT  SYSTEM  DISADVANTAGES 


SOURCE:  Alexander  1977,  17. 

Brandler  1983,  29. 

Dickinson  1979,  225. 

Fishbacker  &  Robertson  1986,  283. 
Madden  1976,  48. 

0^ Keefe  1985.  709. 

Palmer,  Wilson  Hubble  1987,  355. 
Pollard  &  Atkins  1987,  1-2. 
Ratzer,  Fletcher  1978,  167. 
Reisman,  Silva,  Mantell  1978,  50. 
Singer,  Rossfeld,  Hall  1976,  156. 
Stuart  1973,  60-68  &  100. 

Stuart  1976,  392. 

Woerly  1986,  9. 


n 


Centralized  Appointment  System 
Disadvantages 

Lack  c:  knowledge  to  properly  screen  patients  for 
appo intments  . 

Not  designed  to  handle  short  notice,  same  day  acute  illnesses. 

Lack  of  flexibility  to  handle  emergencies,  patients  and 
neat me nt  needed. 

Increases  the  coordination  and  communication  needed  between 
CAS  and  the  clinics  -  dedicated  telephone  lines. 

5.  Increases  the  amiount  of  training  needed  by  the  appointment 
clerks  -  system  is  more  co mp lex. 

5.  Diminishing  returns  due  to  large  scale  operations  -  too  large 
an  operation  in  o.ne  area  to  manage  efficiently. 

7.  Appointment  clerks  and  telephone  only  service,  is  too 
1  .mpersona i  . 
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APPENDIX  P 

DECENTRALIZED  APPOINTMENT  SYSTEM  ADVANTAGES 


SOURCE;  Alexander  1977,  17. 

Brandler  1983,  29. 

Dickinson  1979,  225. 

Fishbacker  &  Robertson  1986,  283. 
Madden  1976,  48. 

O'Keefe  1985.  709. 

Palmer,  Wilson  Hubble  1987,  355. 
Pollard  &  Atkins  1987,  1-2. 
Ratzer,  Fletcher  1978,  167. 
Reisman,  Silva,  Mantell  1978,  50. 
Singer,  Rossfeld,  Hall  1976,  156. 
Stuart  1973,  60-68  &  100. 

Stuart  1976,  392. 


Woerly  1986 


9. 


Decentralized  Appointment,  System 
Advantages 


1.  Provides  greater  flexibility  on  appointments  i  overbook ing 
schedule  changes,  time  needed  for  patient  treatment) . 

2.  Cl  i  n i c / Serv 1 ce  chiefs  have  greater  control  over  their  clinic 
operations . 

3.  More  personal  service  tallows  patients  to  make  appointments  i: 
person)  . 

4.  Ability  to  m»ake  follow-up  appointments  before  departing  the 
clinic. 

0.  Ease  of  ootaining  same-day  appointments. 

•0  .  Increased  ability  to  triage  patients  -  access  to 
nurse / phys i c i an  s  ta : :  . 

7.  Increased  accessibility  by  health. -are  providers  i  .n  the 
appointment  process. 

3.  Ease  of  communications  between  the  physician  and  the 
appointment  clerk  on  special  patient  needs. 

9.  Personnel  are  more  familiar  with  clinic  standard  operating 
procedures . 


10,  Reduced  training  time  o:  appointment 


•OSS  comoiex 


S  V  3  *v  0  JTi . 


.  1.  May  increase  the  number  of  staff  a'/ailabie 
e 1 e o h c n e  in  the  clinic  area. 


?.  n  3  we  r  *  -  e 


12.  Patient’s  perceptions  that  decentra  1 1  zed  syste.ms  are  .more 
r e s r c n 3  1 V e  to  their  .needs. 


13.  May  increase  appointment  cersonne..  .morc^le,  resulting  in  lowe] 
turnover  by  bringing  them  closer  to  the  daily  patient  care 
demands  in  a  clinic. 
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APPENDIX  Q 

DECENTRALIZED  APPOINTMENT  SYSTEM  DISADVANTAGES 


SOURCE:  Alexander  1977,  17. 

Brandler  1983,  29. 

Dickinson  1979,  225. 

Fishbacker  &  Robertson  1986,  283. 
Madden  1976,  48. 

O’Keefe  1985.  709. 

Palmer,  Wilson  Hubble  1987,  355. 
Pollard  &  Atkins  1987,  1-2. 
Ratzer,  Fletcher  1978,  167. 
Reisman,  Silva,  Mantell  1978,  50. 
Singer,  Rossfeld,  Hall  1976,  156. 
Stuart  1973,  60-68  &  100. 

Stuart  1976,  392. 


Woerly  1986,  9. 


Q.  U 


VS  ^em 


Decentralized  Appointmen"  S 
Disadvantaiges 


2.  Lack  of  depth  with  the  number  of  appointment  personnel 
'coverage  when  sick,  on  leave,  absent,  etc.;. 

2.  Multiple  telephone  numbers  for  the  patient  to  remember. 
Increased  patient  e'ducation  needed  to  gain  access  to  the 
appointment  system. 

3.  'Jn  f  ami  i  1  ar  1  ty  with  otlner  cii.nic  procedures  -  .tiore  difficult  to 
properly  refer  a  patient  to  another  clinic's  appointment  area 
(mini ma 1  intra-depart mental  coordination  resulting  in  excessive 
transferring  of  patient  calls). 


4.  May  decrease  appointment  clerk  productivity.  .^ppointi.ng  of 
walk-up  patients  requires  more  time  than  those  requesting 
appointments  'oy  p'hone  . 


increase  in  te.epnone  ana  ii.ing  noise  i  .n  tne  o*inic  areas. 
Mav  recuire  more  manoower  due  to  diseconomies  o:  scale. 


7.  May  require  additional  telephone  lines  and  call  sequencers. 

■3.  Appointment  clerk  may  decrease  physician  productivity.  The 
hysician  can  .more  easily  be  interrupted  for  questions  due  to  a 
o-located  appointment  area. 

'3.  Possible  reduction  of  synergistic  unity  and  cohesion  normally 
found  in  a  central  aopointment  area  -  reduces  employee  morale, 
increasing  employee  turnovers. 


10.  Patients  may  not  cancel  all  their  appointments  resulting  in 
increased  no-slnows  due  to  the  number  c:  telephone  calls  needed 
cancel  multiple  appo intments . 
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APPENDIX  R 

CLASSIFICATION  OF  STAFF  RESPONSES 


CLASSIFICATION  OF  STAFF  RESPONSES 
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APPENDIX  S 

COMPARISON  OF  STAFF  SURVEY  REPORTS 


conrmisQN  of  staff  survey  reports » 
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APPENDIX  T 

COMPARISON  OF  CLINIC  SURVEY  REPORTS 


COMPARISON  OF  CLINIC  SURVEY  REPORTS 
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APPENDIX  U 

SUMMARY  OF  STAFF  RESPONSES 


OVERALL  SUMM^!>Y  OF  STAFF  RESPOHSES 


c 

m  c 

o 

o 

fr*  m 


>h  *1 

u 


-  ^  V.  ’  X  •  -< 


-a  «» 

«» 

•  ^  «Qi 
•C  Q9  «-* 
«»««.«.* 
^  49, 

«  4  «a> 
z  ca  flo 


>% 

tm  m 

m  ^ 

c/a 


asi 


M 

O 

<o  o 


I 

o 


X 

o 


I 

o 

1 


X 
o  cn 
ct  • 
ra 


X 

r-  o 


CO 

to 


X 

09 

(r>  o 


X 

o 

o 


X 

(A 


X 

in 


X 

in  o) 


o 

CO 


X 
Gb  r- 


X 
lO 
—  CN 


X 

o 
o  o 


X 

CO 


X 
C*  lO 


o 

rO 


CO  X 
—  in 
lO 


X 

cc  «o 
cc 


•m 

c 

4A 

• 

mm 

9 

• 

9 

9 

41 

o 

c 

3 

mJ 

•c. 

o 

G 

e 

U 

mm 

tm 

tm 

•G 

U 

<Sm 

O 

e 

G 

mm 

o 

o 

c 

9 

9 

9 

•«« 

<« 

u 

mm 

9 

2 

mm 

'•Q 

A 

41 

•o 

4» 

U 

c 

•m 

c 

41 

3 

9 

o 

G 

C 

c 

o 

M 

c 

s 

•o 

9 

T? 

•m 

V 

Jj 

■o 

JS 

-o 

tm 

•o 

•m* 

41 

— 

c 

9 

>« 

f 

(« 

w 

41 

c  u 

4> 

dO 

o 

K. 

9 

B 

« 

9 

• 

A 

> 

•mm 

41 

a 

6 

C 

9  9 

!• 

O 

•m 

4« 

41 

3 

JS 

9 

9 

-• 

6 

«> 

u 

U 

9  9 

w 

•mm 

C 

CJ 

tm 

9 

9 

•j 

o 

c 

o 

o 

9 

Cl 

CL  O. 

•1 

«■ 

c. 

cr 

ec 

9 

3 

«• 

mm 

9 

m» 

tm 

c 

■*> 

C“ 

9 

a. 

41 

O 

3 

•m* 

• 

O 

m* 

•mm 

6 

Ok 

41 

•M 

9 

JH 

c 

Ow 

^  -* 

9  U 

O 

O 

JS 

mJ 

■m* 

9 

9 

> 

o 

■o 

m» 

m 

9 

C 

JS  CL 

c 

«4 

X  <iJ 

e 

4 

G 

9 

9 

9 

•mm 

o 

41 

G 

9 

m 

41 

«* 

4» 

« 

u 

o 

01 

9 

C 

9 

•mm 

tm 

tm 

9 

o. 

0» 

41 

tm 

A 

• 

• 

a 

• 

6 

JS 

9 

B 

■o 

JS 

a 

•mm 

9 

9 

G 

3 

a 

3 

JS 

% 

<« 

9  JS 

m» 

■mA 

mJ 

41 

9 

mt 

«■> 

X 

2 

O 

3 

m* 

o 

C 

e 

o 

JS  c 

41 

G 

e 

c 

41 

o 

•m 

c 

41 

O 

9 

CJ 

mm 

O 

9 

a 

c 

X 

•o 

9 

JS 

o 

c 

35 

3 

mm 

ss 

JS 

9 

— • 

mJ 

X 

<1 

— • 

9 

9 

fi 

o 

O  JS 

O 

o 

o 

o 

A 

m» 

c 

mm 

mJ 

o 

JS 

o 

m 

o  o. 

w  «» 

a 

3 

& 

3 

3 

A 

o 

3 

c 

— • 

9 

oj 

• 

CJ 

tm 

> 

• 

O  A 

9  -m 

A 

• 

O 

o 

A 

o 

» 

O 

A 

41 

• 

O 

41 

mm 

■o 

• 

>s 

A 

O 

C9 

•Am 

m 

X  *♦ 

6  * 

O’ 

«o 

9 

>1 

r** 

X 

9 

A 

CO 

>k 

s 

u 

9 

O) 

o 

9 

(01 

X 

o 
«o  o 


X 

m 


X 

in 


X 

in  a» 


o 

CO 


o 

CO 


X 

fO 


X 

o 

93  O 


X 

Ok 

r-  • 

lO 

CO 


X 

p* 


CO  X 
CO 


X 
PC  CO 


X 
CD  *** 


X 


X 

o 
CO  o 


X 
—  PC 


X 

Cb 


CD  X 
CO 


X 
^  PC 
PC  • 
PC 

in 


X 
O  X 


c 

o 


D.  Shields  111 


APPENDIX  V 

COMPARISON  OF  STAFF  RESPONSES  BY  TENURE 


COMPARISON  OF  STAFF  RESPONSES  BY  TENURE  ♦ 


6  months 

1  year 

More 

Less  than 

to 

to 

Tnan 

6  months 

11  months 

3  years 

3  vears 

4.  Your  ability  to 

25/;=VS 

507.=VS 

387. = VS 

42’/.=Vs 

ootain  patient  and 

757.=S 

50y.=N/A 

46y.=3 

257=3 

schedule  intormation 

4y.=D 

257=0 

■from  the  appointment 
svscem? 

127.=N/A 

b7.=N/A 

How  satisfied  are 

257.=VS 

507.=S 

25:;=vs 

£7=VS 

you  that  the  central 

i3y.=s 

50y.=N/A 

25y.=S 

507=3 

appointment  clerk 

137.=N 

i7y.=N 

87=D 

matches  the  patient 

137.=VDS 

87.=D 

34y.=N/A 

with  the  proper 

377.=N/A 

8y=VDS 

aoDointment  slot? 

l7y.=N/A 

6.  How  satisfied  are 

25y.=vs 

5oy.=s 

42*/.=VS 

34 7= VS 

you  with  your  ability 

25y.=s 

50y.=N/A 

337.=S 

257=S 

to  contact  the  central 

l3y.=D 

47.=N 

87.=N 

appointment  clerk  when 

37y.=N/A 

47.=D 

34y.=N/A 

vou  need  to? 

177.=N/A 

7.  How  satisfied  are 

i3y.»vs 

5oy.=s 

•  337.=VS 

427=VS 

you  with  the  number  of 

5oy.=s 

50y.=N/A 

177.=S 

427.=S 

appointment  scheduling 

i3y.=N 

127.=N 

87=N 

people  in  your  area? 

23y.=N/A 

87.= D 

12y.»VDS 

l7y.=N/A 

87=0 

S.  How  satisfied  would 

i3y.=s 

5oy.=vs 

i7y.=vs 

257=VS 

you  be  if  all  appoint¬ 

37y.=N 

50y.=VD3 

4y.=s 

S7=N 

ments  were  made  in  the 

I3y.-VDS 

8y.=N 

67y.=VDS 

clinic  area  (given  no 

37y.=N/A 

3S7.=D 

additional  staffing)? 

29y.=VDS 

4y.=N/A 

9,  Your  Overall  ooinion 

13/:= vs 

5oy.=vs 

25y.=VS 

17y.=VS 

of  the  appointment 

62y.=3 

50y.=N 

5oy.=s 

537=3 

system  used  to  make 

i3::=N 

8y.=N 

17y.=N 

appointments? 

i3y.=D 

i2y.=D 

87=0 

4V.=VDS 

Total  #  of  Personnel;  46 

8 

2 

24 

12 

■*  N/A  =  Not  Applicable 

N 

=  Neither  Satisfied 

or  Dissatisfied 

(3) 

VS  =  Very  Satisfied  (5) • 

D 

=  Dissatisfied  (2) 

S  “  Satisfied  (4) 

VDS 

=  Very  Dissatisfied 

(1) 
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appendix  « 

APPOINTMENT  SYSTEM  STAFF  WRITTEN  COMMENTS 


y 


SURVEY  SUMMARY 


If  you  could  change  anything  about  the  appointment  system,  what  would  it  be? 

Cooperation  and  Interpersonal  Communications: 

1.  Need  more  communications  and  cooperation  between  the  clinics  and  the  central  appointment 
staff  on  policies,  changes  etc. 

2.  Change  the  staff  opinion  of  the  quality,  expertise,  and  skill  required  of  appointment 
clerks . 

Training : 

3.  Reduce  the  double  booking  of  patients  which  occurs  at  times. 

4.  Be  sure  appointments  are  confirmed  in  the  system  when  booked. 

5.  Occassional  active  duty  appointments  show  no  patient  on  the  system,  but  they  were  given  an 
appointment . 

6.  Central  appointment  clerks  sometimes  don't  follow  clinic  guidelines.  Clerks  should  be 
familiar  with  clinic  guidelines. 

7.  Have  specific  appointment  clerks  responsible  for  specific  clinics  and  knowledgable  about 
what  questions  to  ask  the  patients. 

8.  Make  sure  all  appointments  to  the  surgery  clinic  are  related  to  surgical  problems. 

9.  Have  more  than  one  person  in  the  MTF  be  able  to  access  the  appointment  roster  or  patient 
history  at  the  same  time. 

10.  Be  able  to  screen  the  physician  appointment  schedule  at  least  2  days  in  advance  of  the 
desired  date. 

11.  ACCESS  System  is  very  slow  taking  the  updates  to  the  appointment  templates.  Changes  taking 
more  than  a  couple  of  minutes  to  be  applied. 

12.  Have  the  ability  to  print  the  information  appearing  on  the  screen  (i.e.  address,  phone 
number) . 

13.  Need  more  access  to  other  patient/clinic  history  and  other  information. 

ACCESS  Hardware  Recommendations: 

14.  Need  more  access  to  printers. 

Telephone  Comments  (Accessibility): 

15.  Increase  access  to  the  central  appointment  clerks  by  the  staff. 

16.  More  direct  provider  lines  to  central  appointments  (not  enough  at  present). 

17.  We  need  1-2  more  telephone  lines  in  Acute  Care. 


SURVEY  SUMMARY 


ACCESS  Software  Rgcommenda* ions: 

18.  Better  software  for  ACCESS. 

19.  More  flexible  Ad-Hoc  reporting  capability. 

20.  Eliminate  one  of  the  screens  used  to  call  up  a  patient. 

21.  Simplify  computer  program  to  less  steps  and  enable  the  individual  clinics  to  make 
appointment  schedule  modifications  quicker. 

22.  Need  to  allow  the  clinics  to  show  the  patient  as  a  cancellation  (instead  of  a  'no-show'} 
after  the  time  of  the  appointment. 

23.  Have  the  system  computed  weighted  workload  values. 

24.  Mechanism  to  prioritize  appointments  by  patient  severity  of  illness. 

Policy  Recommendations; 

General 

25.  Need  more  copies  of  the  appointment  rosters  for  clinic  personnel  use. 

26.  Allow  patients  to  call  anytime  and  be  scheduled  or  waitlisted  (open  appointment  books 
daily)  . 

27.  Increase  the  number  of  patient  appointment  slots. 

28.  Make  Family  Practice  patients  go  to  Family  Practice  for  pediatric  ear  rechecks,  well  baby 
checks,  and  GYN  needs.  This  will  free  up  Peds  and  GYN  appointments. 

29.  Be  able  to  spend  more  time  with  the  patients  on  the  phone  making  appointments. 

30.  Don't  let  patients  book  routine  follow-ups  before  the  physician  recommended  time  (i.e. 
return  in  2  weeks) . 

31.  Standardize  the  system  of  referrals  (using  SF  515  consult)  between  the  clinics.  Different 
clinics  have  different  procedures  and  places  to  send  the  513. 

32.  More  accessibility  of  providers  to  the  system.  I  would  like  the  ability  to  schedule 
patients  myself. 

33.  Put  all  OB/GYN  patient  appointments  in  the  computer  and  get  rid  of  the  manual  appointment 
books  used. 

34.  Get  rid  of  the  whole  system,  it  makes  my  work  2-3  times  as  hard. 

35.  Eliminate  AQCESS  from  the  Mental  Health  Clinic  -  the  system  is  confusing. 


SURVEY  SUMMARY 


Centralize  the  System 


36.  Have  central  appointments  book  acute  appointments. 

37.  Continue  the  trend  toward  centralizing  the  appointment  system. 

Decentralize  the  System 


38.  Decentralize  the  appointment  system  and  put  the  clerks  near  the  clinics. 

39.  Allow  the  clinic  to  do  scheduling,  but  provide  an  extra  person  due  to  the  high  volume  oi 
appointments . 

40.  Decentralize  the  appointment  process  so  I  can  increase  my  patient  count,  and  the  patient 
accessibility  to  the  clinic.  Then  1  can  flexibly  manipulate  the  schedule  as  needed,  and  match 
the  proper  patient  to  the  proper  provider. 

41.  Allow  the  OB/GYII  clinic  to  make  their  own  appointments.  The  clinic  personnel  are  trained 
to  screen  problems  and  match  the  right  patient  with  the  right  provider. 

42.  Specialty  clinic  appointments  should  be  booked  by  the  clinic  only. 

43.  I  would  rather  have  a  clinic  902X0  technician  schedule  clinic  appointments. 


SURVEY  SUMMARY  -  POSITIVE  COMMENTS 


How  would  one  additional  ^ull-time  appointment  clerk  af-fect  tne  patient  care  provided  in  your 
area? 

General ; 

1.  Very  help-fui. 

2.  Wondertul . 

3.  It  would  imorove  patient  care. 

4.  It  would  imorove  (75-100'/.)  the  service  we  are  aole  to  deliver. 

Acooi  ntment  Accessi  bi  1  i  tv/Admi  r,i  strati  ve/Clinicai 

5.  Help  to  provide  Petter  patient  appointment  services  during  employee  absences. 

6.  It  would  make  it  easier  ■for  patients  to  contact  the  appointment  clerk. 

7.  Help  to  answer  the  phones  more  rapidly. 

8.  It  would  help  to  give  su-f'ficient  time  to  call  the  patient. 

9.  Would  help  us  immensely  witn  administrative  items  during  busy  hours. 

10.  Allow  the  902X0  clinic  technician  to  devote  more  time  to  clinical  activities. 

11.  It  would  allow  one  person  to  schedule  patients,  ■file  paperwork  and  ■forms  -fulltime.  It  is 
now  di^f^ficult  to  make  appointments  at  the  convenience  of  walk-in  patients. 

Grouping  o^f  Co-located  Clinics; 

12.  Great,  I'll  support  the  appointment  clerk  with  a  technician  when  the  clerk  is  on  leave.  1 
would  also  support  a  grouping  ai  clinics  under  one  appointment  clerk  located  nearby. 

13.  A  grouping  o-f  clinics  (i.e.  ENT  and  Qphthamology)  under  one  clerk.  It  would  allow  the 
clinic  NCOIC  to  perform  numerous  other  duties  (screening,  visual  fields,  etc.). 

IR.  Would  improve  the  present  system  if  the  clerk  was  pnysically  near  and  only  scheduled  our 
aoooi ntments. 

15.  OK,  but  not  grouped  with  anyone. 

Contingent  Comments  (Space.  Clerk  Competence); 

16.  Ideal  situation,  but  no  space  to  put  them. 

17.  It  would  depend  on  the  competence  and  interest  of  the  clerk  (medical  terminology  and 
unasrszsnding) . 


SURVEY  SUnrtARY  -  NEGATIVE  CPnrtENTS 


How  would  one  adoitional  full-time  appointment  clerk  affect  the  patient  care  provided  in  your 
area? 

Waste  of  time  in  small  clinics. 

2.  One  appointment  clerk  would  not  be  very  busy. 

Cause  more  problems  and  work  in  the  long-term. 

A.  We  don't  want  to  make  our  own  appointments. 

It  would  be  worse. 

6.  No  affect  at  all. 

7.  N/A  -  we  presently  make  all  our  own  appointments. 
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APPENDIX  X 

1987  AIR  FORCE  HEALTH  CARE  SURVEY  -  RESULTS 


1987  AIR  RORCE  HEALTH  CARE  SURVEY  -  Results  ♦ 


Written  Patient  Comments  ** 


Tne  survey  was  administered  to  a  total  o-f  279  persons  with  the  -following  results; 

-  73  persons  (26.2’/.  o-f  those  surveyed)  cnose  to  make  written  comments 

-  A  total  o-f  IIS  separate  comments  were  made 

—  4B  comments  were  positive  in  nature  (4rA) 

- General  Courtesy  and  Treatment:  43  comments  (90’/.) 

-  Pharmacy;  1  comment  (2%) 

-  Facility:  1  comment  (2%) 

- Family  Practice:  2  comments  (4’/.) 

- Appointment  System:  1  comment  (2’/.) 

—  70  comments  were  negative  in  nature  (59’/C) 

General:  4  comments  (6*/.) 

- Pharmacy;  5  comments  (7*/.) 

- Courtesy  and  Treatment:  7  comments  (10’/.) 

- uack  o-f  Services;  6  comments  (9;i) 

- Dental;  1  comment  (!’/.) 

- Facility;  2  comments  (37.) 

— —  Emergency  Room;  2  comments  (3‘/.) 

- Family  Practice;  8  comments  (11*/.) 

— —  OB  Ward;  3  comments  (47) 

-  Radiology;  3  comments  (47) 

- Aerovac:  1  comment  (17.) 

- Appointment  System;  20  comments  (29’/.) 

- Meaical  Records;  5  comments  (9’/.) 

- Peterson  Clinic:  2  comments  (37.) 


♦  -  Administered  to  patients  cnosen  -from  pe-sons  who  presented  -for  care  at  the 
USAF  Academy  Hospital  during  December  1967  and  January  1988. 

-  Not  necessarily  a  statistically  random  sampling. 

-  Survey  instrument  may  not  be  statistically  validated. 

-  Survey  instructions  mandated  at  least  60  persons  per  category  or  respondent. 

The  survey  question  was  as  -follows;  '^'lease  use  the  space  below  to  tell  us  what 
you  think  about  tne  way  we  are  providing  medical  care.  Your  comment  will  oe 
compiled  and  will  be  usee  by  the  executive  management  o-f  this  medical  treatment 
-facility  in  making  decisions  -for  change. 


1967  Air  Force  Health  Care  Survey  -  Results  ♦ 


Appointment  System  Satisfaction  ♦* 


Very 

Very 

No 

Beneficiary  Cateoory 

Total 

Satisfied 

Satisfied 

Neutral 

Dissatisfied 

Dissatisfied 

Resoonse 

66 

8 

13 

13 

nn 

10 

Active  Duty 

247. 

127. 

207. 

207. 

337. 

\5V. 

Dependent  of 

67 

7 

12 

17 

4 

Active  Duty 

247. 

117. 

377. 

187. 

257. 

67. 

37. 

79 

21 

28 

8 

14 

6 

2 

Retiree 

287. 

277. 

357. 

107. 

187. 

87. 

27. 

Dependent  of  Retiree 

67 

10 

21 

17 

13 

6 

or  Deceased  Member 

247. 

157. 

317. 

267. 

197. 

97. 

Total  #; 

279 

46 

87 

50 

66 

26 

4 

Total  7.: 

1007. 

17/. 

317. 

187. 

247. 

97. 

17. 

*  -  Administered  to  279  patients  chosen  from  persons  who  presented  for  care  at  the  USAF 
Academy  Hospital  during  Decemoer  1987  and  January  1988. 

-  Not  necessarily  a  statistically  random  sampling. 

-  Survey  instrument  may  not  be  statistically  validated. 

-  Survey  instructions  mandated  at  least  60  persons  per  category  of  respondent. 

*♦  Survey  Question  #31:  Please  tell  us  how  satisfied  you  are  with  the  Appointment 
System  Services? 


1967  Air  Force 

Health  Care  Survey  - 

Results* 

Category  of 

Survey 

Respondent 

Beneficiary 

Dependent 

Dependent  of 

Active 

of 

Retiree  or 

Survey  Question  #4 

Duty 

Act.  Duty 

Retiree 

Deceased  Mbr 

57 

49 

59 

34 

A. 

Not  Applicable 

86X 

747. 

757. 

517. 

3 

1 

3 

3 

B. 

Lack  of  Services 

57. 

17. 

47. 

57. 

C. 

Not  Convenient 

1 

17. 

D. 

Lack  of  Courtesy 

1 

1 

E. 

Provider  Not  Thorough 

17. 

17. 

F. 

Lack  of  Explanation 

1 

17. 

1 

1 

8. 

Different  Providers 

17. 

17. 

H. 

Schedule  Conflict 

1 

3 

6 

4 

I. 

Difficult  to  get  an 
Appointment 

17. 

47. 

.  77. 

67. 

5 

13 

10 

'’2 

No 

Response 

87. 

207. 

137. 

347. 

Total  #(279); 

66 

67 

79 

67 

Total  7.(100); 

1007. 

1007. 

1007. 

1007. 

*  -  Administered  to  279  patients  cnosen  -from  persons  who  presented  -for  care  at  the  USAF 
Academy  Hospital  during  December  1987  and  January  1983. 

-  Not  necessarily  a  statistically  random  sampling. 

-  Survey  instrument  may  not  be  statistically  validated. 

-  Survey  instructions  mandated  at  least  6i3  persons  per  category  oi  respondent. 


**  I-f  you  do  not  receive  the  majority  of  your  health  care  from  an  Air  Force 

medical  treatment  facility,  which  one  of  the  following  best  explains  why  not? 


1967  AIR  FORCE  HEALTH  CARE  SURVEY 


Patient  Hi  ah  Sa-cis-faction  Comments 


The  survey  Question  was  as  -follows!  Please  use  the  space  below  to  tell  us  what  you 
think  about  the  way  we  are  providing  medical  care.  Your  comment  will  be  compiled  and 
will  be  used  by  the  executive  management  o-f  tnis  medical  treatment  -facility  in  making 
decisions  -for  change. 


GENERAL  C0UPTE3Y  AND  TREATMENT 

1.  I-f  conditions  remain  as  they  are  now,  I  will  not  complain. 

2.  Medical  care  is  good  and  most  doctors  seem  to  care.  They  could  be  a  bit  more 
thorougn  but  in  general  provide  consistent  quality  care. 

3.  I  have  been  more  than  satis-fied  with  the  quality  o-f  the  personnel  and  -facility 
here.  It  is  better  than  most. 

4.  Medical  care  -for  me  and  my  wi-fe  is  outstanding.  No  complaints  what  so  ever. 
Medical  personnel  stationed  here  are,  in  my  judgment,  o-f  the  highest  pro-fessional 
cal iber. 

5.  Medical  care  -for  mysel-f  and  wi-fe  has  been  very  good  and  reassuring  -  problems  have 
been  minor  and  are  those  associated  with  the  normal  aging  process. 

6.  I  am  pleased  with  the  care  provided 

7.  I  have  been  receiving  medical  care  at  the  USAF  Academy  Hospital  since  the  late 
1960's.  The  care  and  concern  of  the  staff  (except  for  a  short  time  in  the  70‘s)  has 
been  exceptional.  Each  section  should  be  listed  and  not  just  a  few.  I  have  received 
excellent  care  in  ophthalmology,  nuclear  medicine,  cardiopulmonary,  on  the  wards,  in 
surgery,  and  I'm  sure  I  have  missed  ^ome.  There  could  not  be  a  finer,  considerate 
staff  anywhere. 

8.  I  have  been  receiving  excellent  care  at  this  facility  for  2®  years.  The  care  has 
been  thorough  and  considerate. 

9.  Overall  it  is  fine. 

10.  Tisre  is  an  atmcsphe-'e  of  caring  and  friendliness  even  in  hignly  organized 
routines.  My  hospital  visits  (which  have  begun  in  tne  emergency  room)  are  worthy  of 
high  praise.  The  followup  appointments  has  been  remarkably  efficient  -  especially  in 
Internal  Medicine,  Orthopedics  and  Physical  Therapy.  Earlier  in  Physical  Tnerapy  I 
did  meet  a  physician  who  was  ruce  and  unkinc. 

11.  I  am  well  satisfiec. 

12.  We  have  used  the  Air  Force  Academy  Hospital  for  15  years.  Generally  we  have  had 
e;:cellent  care  and  attention  in  all  areas.  It  has  always  been  our  wish  to  have 
dependent  dental  care  for  the  wife  and  children.  I  really  like  family  practice.  Our 


•family  has  had  good  medical  care.  My  husband  is  retired  at  22  1/2  years.  We  have 
eignt  children. 

13.  My  wi-fe  and  I  have  been  using  this  -facility  since  returning  -from  tne  Navy  in  1959. 
We  are  both  in  agreement  that  we  have  received  the  best  treatment  we  cculd  receive 
anywhere  and  are  very  appreciaci ve  and  thark-ful  -for  what  we  have  receivea.  Thank  you 
very  much. 

14.  Most  care  has  been  adequate. 

15.  I  think  this  -facility  is  ve-^y  good  compared  with  other  military  and  civilian 
facilities.  Thank  you! 

16.  I  have  had  excellent  medical  care  from  the  doctors  and  aides  in  this  facility. 

17.  Service  has  been  highly  satisfactory  within  resources.  Vacant  soecialist 
positions  have  necessitated  appointments  at  other  facilities  (Army  and  VA) ,  on  several 
occasions. 

IS.  I  believe  the  USAF  Academy  Hospital  is  a  top  notch  facility.  PA  Malone  is 
thorough,  competent  and  pleasant  to  deal  with.  I  am  fortunate  to  enjoy  the  services 
of  this  hospital . 

19.  Excellent  facility,  dedicated  personnel,  professional  care. 

20.  Excellent,  keep  up  the  good  work. 

21.  I  find,  for  the  most  part,  that  the  Air  Force  Academy  Hospital  does  a  very  good 
job.  I  have  been  treated  very  well  here  for  eight  years  now. 

22.  I  think  that  the  care  provided  here  is  very  good,  as  far  as  1  can  see. 

23.  Health  care  providers  did  everything  possible  to  get  to  the  root  of  my  problem, 
and  I'm  very  grateful  for  it. 

24.  I  am  delighted  with  the  Air  Force  Academy  Hospital  in  every  respect. 

25.  I  have  received  very  good  care  especially  in  1937.  The  parking  has  greatly 
improved.  The  doctors  and  clinic  workers  are  caring  and  helpful. 

26.  I've  been  using  this  medical  facility  since  1964.  My  son  was  born  here  and  he  was 
diagnosed  a  moderately  severe  as-^hmatic  at  approximately  3  weeKS  of  age.  I  have  had 
several  surgeries  here  and  all  I  can  say  is  that  we  have  been  given  the  very  best  of 
care  at  all  times  by  everyone.  My  thanks  to  all  for  such  fine  care.  Makes  me  proud 
to  have  been  in  the  Air  Force. 

27.  I  have  been  truly  satisfied. 

28.  I  live  in  Penrose  County  (bv  choice)  and  I  prefer  using  the  Academy  hospital 
because  of  the  superior  care  I  receive  here  versus  Fort  Carson.  Thank  you. 

29.  The  medical  personnel  are  polite. 

30.  Overall  this  facility  does  provide  good  care. 


31.  Recently  I  was  admitted  on  an  inpatient  oasis  -for  BYIM  surgery.  The  hosoital  anti 
clinic  sta-f-f  were  excellent.  Dr  Berryman  is  one  o-f  the  most  competent  fiir  Force 
physicians  that  I  have  seen  in  the  22  years  I  have  been  an  Air  Force  dependent.  The 
pre  operative  care,  laboratory  work,  was  also  excellent.  I  appreciate  the  care  I 
received  very  much. 

32.  This  past  week  my  son  had  surgery.  The  surgeon  explained  everything  to  me  and  was 
extremely  supportive  o-f  the  -family  and  was  concerned  about  the  -fears  that  we  hao. 

33.  I’ve  recently  moved  to  this  area  and  have  used  this  -facility  twice.  I  am  familiar 
with  military  facilities  and  I  know  that  of  all  the  facilities  in  the  Colorado  Springs 
area  I  will  continue  to  make  the  45  minute  drive  to  get  here. 

34.  1  receive  my  major  care  (neuro  surgery)  and  followup  at  Fitrsimons.  I  am  very 
satisfied. 

35.  Most  people  are  nice  and  also  thorough. 

36.  I  had  surgery  done  by  Dr  Mediavilla  and  found  him  to  be  caring,  professional  and 
very  competent! 

37.  Physical  Therapy  personnel  have  always  been  great. 

33.  Our  family  feels  that  care  is  more  easily  obtained  here  than  at  any  place  we  have 
been  stationed  in  16  years.  Parking  is  no  problem  and  we  see  the  same  provider  almost 
all  the  time. 

39.  I  am  extremely  satisfied  with  the  Pediatric  Clinic.  The  doctors  and  staff  are 
very  friendly  and  caring.  They  answer  any  questions  when  I  call  in  with  a  problem. 

40.  I  am  satisfied  with  the  treatment  I  received  in  the  clinics. 

41.  No  complaints,  every  service  is  excellent  and  highly  appreciated. 

42.  By  having  a  choice  between  the  Army  facility  and  the  Air  Force,  I  selected  the  Air 
Force  for  overall  service  performance,  attitude,  and  care.  The  Air  Force  provides 
more  personal  contact,  not  "robotic"  and  the  cold  treatment  I  have  witnessed  and 
experienced  at  the  Army  facility.  If  anything  I  can  say  that  I've  experienced  here 
tnat  caused  me  inconvenience  was  while  an  inpatient.  There  appears  at  that  time  to  be 
a  manpower  shortage,  other  than  that,  excellent.  Your  services  are  excellent. 

43.  The  Air  Force  Academy  clinic  has  been  outstanding.  Due  to  personnel  shortages  in 
some  areas,  I  have  had  to  go  to  other  facilities  for  some  consultations  and  service. 

FACILITY 

44.  The  parking  situation  is  now  improved. 

PHARMACY 

45.  The  most  efficient  department  is  the  Pharmacy. 


APPOINTMENT  SYSTEM 


46.  The  aopcintment  personnel  are  wonder-ful  and  very  coLirtecus. 

FAMILY  PRACTICE 


47.  We  are  an  active  duty  Air  Force  -family  enrolled  in  the  Family  Practice  Clinic.  I 
generally  see  PA  Schiachter  and  am  always  pleased  with  his  pro-f essi onal  i sm  and  the 
quality  of  our  care. 

48.  The  Family  Practice  operation  is  great,  try  not  to  change  it  and  don't  reassign 
all  the  people.  Leave  it  alone.  I've  noticed  that  each  time  new  management  comes  in, 
they  reorganise,  not  always  for  the  best.  I  realise  reorganisation  is  a  "must"  if 
you're  working  for  a  promotion,  but  from  a  patient's  point  of  view  -  it's  start  ove’^ 
with  a  new  system,  a  new  doctor,  and  a  new  PA. 


1967  AIR  FORCE  HEALTH  CARE  SURVEY 


Patient  Dissatisfaction  Comments 


The  survey  question  was  as  -follows:  Please  use  the  space  below  to  tell  us  wnat  you 
think  about  the  way  we  are  providing  medical  care.  Your  comment  will  be  compiled  and 
will  be  used  by  the  executive  management  o-f  this  medical  treatment  -facility  in  making 
decisions  -for  chance. 


GENERAL 


1.  C-f  concern  tho,  as  one  gets  older,  might  be  some  con-fusion  on  -future  needs  as 
regards  to  the  orocedures  to  obtain  care  at  65  (medicare).  Also,  what  should  be  cone 
in  the  event  o-f  an  emergency  -  at  home  -  on  the  road  etc.  Do  we  call  911  and  request 
to  be  transported  to  the  Air  Force  MTF?  I  guess  I  am  thinking  of  an  education  program 
-for  distribution  -  maybe  print  outs  in  the  waiting  room  brochure  rack. 

2.  Active  duty  personnel  should  have  higher  priority  to  minimize  the  work  impacts. 

3.  We  should' be  able  to  talk  directly  with  the  clinic  doctors  on  the  telephone  about 
our  problems. 

4.  When  someone  has  had  back  pain  -for  three  months  and  is  -finally  re-ferred  by  their 
PA  to  orthopedics,  they  shouldn't  have  to  wait  -four  months  -for  a  consult ! 


PHARMACY 

5.  Getting  prescriptions  takes  too  long. 

6.  Getting  prescriptions  -filled  takes  too  long. 

7.  Getting  prescriptions  is  perhaps  the  most  -frustrating  time. 

8.  The  pharmacy  policy  conflicts  with  the  doctors  prescription  policy.  Their  refusal 
to  issue  long-term  prescriptions  necessitates  multiple  visits  for  the  same  refill  and 
causes  a  waste  of  their  time  (doing  repeat  refills),  and  the  patient's  time  and  lost 
wor  k  time. 


7.  The  pharmacy  needs  help.  Nobody  should  have  to  wait  30-45  minutes  (or  longer)  for 
a  prescription  I 


CCURTESY  AND  TREATMENT 

10.  Some  people  are  not  nice,  they  are  abrupt  and  seem  to  rush  you  out  without 
thorough  checks. 

11.  The  personnel  can  stand  to  be  more  oolite  and  considerate  of  individual  needs. 

12.  The  doctors  are  so  busy,  there  is  often  not  enough  personal  care  -  especially  in 
orthopedics. 


13.  The  capability  o-f  being  able  to  see  the  same  doctor  is  great.  She's  very  triendiy 
and  help-f'ul  -  but  the  ccmolaints  and  symptoms  are  still  there  or  vary  just  slightly 
atter  tour  years.  It  seems  to  me  they  snould  be  able  to  get  to  tne  root  ot  tne 
problem  by  now.  I'm  at  the  point  or  desperation.  I  -feel  like  noDoay  is  real  1  v 
listening  to  what  I  have  to  say,  as  it  gets  repeated  visit  after  visit,  then  all  at 
once,  it's  like  she  finally  heard  some  of  it  and  actually  sounds  surprised  that  I  had 
that  sytr-tom. 

14.  Customer  service  is  at  times  poor. 

15.  When  one  waits  to  see  a  physician,  it  appears  like  there  are  too  many  personnel 
standing  around,  not  looking  busy  -  discussing  last  nights  bowling  etc.  You  wouldn't 
do  this  in  a  private  hospital. 

16.  Doctors  do  not  look  for  out  of  the  ordinary  medical  proolems,  especially  after 
they  find  one  thing  wrong.  Doctors  in  most  cases,  are  uncaring  and  if  they  find 
nothing  wrong  in  the  routine  test  results  they  tend  to  give  up  and  tell  the  patient 
they  "just  think"  they  are  ill.  Almost  lost  a  loved  one  because  of  this  problem  twice 
in  three  years. 


LACK  OF  SERVICES/PERSONKEL 

17.  There  are  not  enough  soecialists.  If  one  is  needed,  the  individual  must  seek 
civilian  care.  This  is  true  not  only  at  this  base,  but  many  others.  Using  CHAMPUS  to 
help  defray  the  costs  is  still  not  enough. 

18.  As  a  dependent  who  wears  a  hearing  aid  there  are  no  services  for  me  to  get 
batteries  or  maintain  my  hearing  aid.  I  cot  the  hearing  aid  while  I  was  on  active 
duty.  Why  is  it  so  hard.  When  I  asked,  no  one  seemed  to  know  exactly  wnat  I  was 
entitled  to,  not  even  the  NCO  or  Captain  in  charge. 

19.  I  realise  that  the  Academy  Hospital  does  not  compare  with  Fitssimons  Army  Medical 
Center  in  sise  or  equipment,  but,  I  must  give  them  a  better  rating  on  courtesy  and 
efficiency.  For  example,  on  my  first  visit  to  Fitssimons  I  was  seen  by  five 
departments  on  the  same  day,  in  effect  saving  me  five  140  mile  trips. 

20.  I  see  a  chiropractor  downtown  and  I  am  unable  to  get  CHAMPUS  to  pay  anything.  You 
need  to  have  a  chiropractor  here  on  base.  I  have  to  spend  a  lot  of  money  on  this  when 
others  let  their  insui^ance  companies  pay. 

21.  I  get  tired  of  waiting  sometimes.  The  hosoital  doesn't  seem  to  be  large  enough  to 
handle  all  the  Air  Force  Academy,  Peterson  AFP  and  Space  Command  personnel.  It  is  a 
long  crive  fcr  the  Peterson  pecole  to  come  here. 

22.  I  believe  the  hospital  is  under  staffed  for  the  numbers  needing  healtn  care. 


DEN~AL 

23.  It  is  difficult  to  obtain  dental  care. 


FACILITY 


24.  The  Air  Force  Academy  Hospital  desoerately  needs  a  -faceli-ft. 

25.  It  is  dit-ficult  to  obtain  parking. 


EH.ERSENCY  RQOH 

26.  During  a  recent  emergency  my  son  was  refused  treatment  and  had  to  go  by  ambulance 
to  Penrose  Community  Hospital  -from  Black  Forest.  Black  Forest  resiaents  are  always 
re-fused  wnen  the  volunteer  rescue  scuad  calls  the  Air  Force  Academy  hosoital. 

27.  I  have  a  12  month  old  daughter  who  had  a  respiratory  virus.  I  tried  Carson, 
Peterson,  and  the  Academy  -for  open  appointments  and  none  were  available.  I  callad  the 
emergency  room  and  they  said  they  would  not  treat  her  because  it  wasn't  a  bor.i-fied 
emergency.  To  me  it  was  and  I  was  quite  upset  that  I  could  not  get  care  -for  her. 


FAMILY  PRACTICE 


28.  Have  had  di-f-ficulty  getting  adequate  care  -for  my  knee  prooiem  until  now  due  to 
inability  to  see  physical  therapy  and  orthopedics  due  to  Family  Practice  no~  re-ferring 
me. 


29.  Family  Practice  has  sure  been  a  nicer  place  since  the  male  civilian  normally  at 
the  -front  desk  has  been  absent.  I  as  well  as  other  people  I’ve  talked  with,  -found  him 
overbearing  and  a  little  di-f-ficult  to  deal  with. 

30.  The  re-ferral  system  needs  to  be  explained.  1  brought  my  son  to  -family  practice  at 
the  start  o-f  a  complexion  prooiem.  Family  Practice  looked  at  him  several  times  as  tne 
problem  got  worse.  I  -finally  asked  for  re-ferral  to  dermatology.  They  said  I  didn't 
need  referral.  My  son  now  has  permanent  scarring  because  of  this!  Family  Practice 
should  have  referred  me  to  Dermatology  at  the  beginning.  However,  had  I  understood 
the  system,  I  would  have  gone  there  in  the  first  place. 

31.  Very  difficult  to  get  into  Family  Practice. 

32.  Suggest  that  routine  blood  pressure  checks  be  available  in  a  central  location.  It 
takes  too  long  when  it  has  to  be  done  in  Family  Practice  on  a  "last  priority"  basis. 

33.  I  have  not  been  able  to  enter  the  Family  Practice  Service. 

34.  The  Family  Practice  clinic  could  use  a  shot  in  the  arm.  The  medical  tecnnicians 
could  be  more  helpful  and  friendly.  I  am  not  certain  they  even  enjoy  what  they  do.  I 
have  never  seen  anyone  wash  their  hands  after  taking  vital  signs  or  change  tne  paper 
on  the  table  when  vital  signs  have  been  taken. 

35.  An  area  where  this  survey  can  have  an  impact  is  with  the  discourceous  Family 
Practice  office  staf-f.  While  the  quality  of  technical  meoical  care  is  very  gocd,  the 
tecnnicians  seem  to  take  joy  in  being  noncoonerati ve  in  areas  tnat  simply  shoulc  rot 
matter.  Why,  for  instance,  should  I  be  told  by  an  enlisted  man  that  it  is  "against 
policy"  to  drop  off  a  note  for  my  family  physician?  According  to  the  enlisteo  man,  I 


should  CO  bacK  to  my  o-f-fice,  and  place  a  ohone  call.  Do  you  really  e-icourage  this 
counterproductive,  institutionalized  stupidity? 

OB  WARD 

36.  I  -feel  that  the  personnel  cn  the  maternity  ward  are  less  than  caring,  concerned  or 
inte'^ested  in  their  patients  based  on  my  experiences  tnere  in  July  1985.  The  absolute 
bare  minimum  o-f  attention  was  paid  to  me  as  a  -first  time  mother  and  apsolutely  nothing 
in  the  line  o-f  explanations  or  advice  or  encouragement  was  offered  and  when  help  was 
requested,  it  was  given  in  a  very  perfunctory  and  bored  manner.  I  am  grateful  that  I 
had  a  normal  delivery  and  a  normal  baby  but  I'm  not  impressed  with  the  attitude  of  the 
entire  maternity  ward. 

“7.  I  did  net  enjey  my  stay  in  the  maternity  ward.  The  pecole  were  nice  for  about  the 
first  day  -  tnen  you  were  more  or  less  on  your  own.  I  had  to  ask  tnree  times  for  my 
bed  sheets  to  be  changed.  Ue  were  also  expected  to  use  the  pay  phone  down  the  hall, 
instead  o-^  hooking  up  the  phone  in  our  room. 

33.  Recently  I  delivered  my  second  child  here  at  the  Academy.  I  was  very  dissatisfied 
with  the  nurses  in  the  delivery  room.  I  feel  their  care  was  very  unprofessional!  I 
don't  expect  ail  the  tnrills  other  hospitals  offer  but  I  do  expect  professional  care 
for  myself  and  my  baby.  The  suction  wasn't  hooked  up  and  the  wrong  instruments  were  on 
the  tray,  even  the  doctor  was  upset.  My  baby  was  left  unattended  after  birth  on  the 
warmer^  on  her  back! 

RADIOLOGY 

39.  Radiology  neeas  more  waiting  rooms  for  people  who  are  undressed  waiting  for  X-rays 
or  other  tests. 

I  was  scheduled  for  two  different  X-ray  procedures  at  early  morning  appointments 
and  I  arrived  and  was  made  to  wait  45  minutes  for  each  appointment.  I  was  anxious 
about  the  tests  anyway  and  the  long  wait  sitting  in  a  paper  gown  in  a  cold  waiting  room 
didn't  help. 

*1.  My  husband's  set  of  lower  back  X-rays  had  to  be  retaken  because  they  "lost"  them, 
and  it  took  a  long  time  to  get  them  read. 

AcRC’^'EDICAL  EVACUATION 

42.  I  am  TDY  here  for  medical  reasons.  Thus  far  the  hospital  staff  have  been  very 
helpful  and  friendly.  The  problem  I  have  noticed  is  getting  here.  I  was  flown  from 
Grand  Forks  AFB  to  Buckley  Field  (on  a  Saturday)  with  no  problems,  but  then  I  was  more 
or  less  on  my  own  to  find  my  way  here.  Thus  far  this  trip  has  cost  me  an  unexpected 
amount  of  money  for  hotels,  taxies,  and  a  Greyhound  bus  from  Denve-'  to  Colorado 
Sorings.  I  unde'^stand  that  I  will  be  reimbursed  for  these  expenses.  My  concern  is  for 
the  lack  o-f  coordination  to  get  a  person  from  Buckley  Field  to  he:"e.  The  weekdays  might 
be  diffe-'ent  than  the  weekenc.  I  was  flown  in  on  a  Saturday  night  and  no  one  was 
available.  Possibly  when  patients  have  an  appointment  here  they  can  be  flown  to 
Pete’" son  AFB. 


APPOINTMENT  SYSTEM 


43.  Eettirg  acpoi ntments  tnrougn  Central  Apoointments  doesn't  nest  cur  reeos  -  have 
had  to  call  Family  Practice  to  he  seen  on  several  occasions. 

44.  I  am  ve’^y  annoyed  at  the  -fact  that  it  is  almost  imoossible  to  get  through  to  make 
an  appointment. 

45.  The  appointment  system  is  trouble.  It  changes  so  much  I'm  not  sure  where  to  call 
to  get  an  appointment. 

46.  The  waiting  time  -for  05  appointments  is  too  long. 

47.  I  would  like  to  see  a  -faster  means  o-f  getting  an  appointment  by  p-ione.  Many  times 
it  takes  3®  minutes  to  1  hour  o-f  calling  be-rore  getting  through  anc  then  sometimes  I 
have  to  "hold"  -  this  is  poor  -for  long  distance  calls. 

« 

48.  Di-f-ficulty  with  tne  appointment  system. 

49.  I  -find  it  very  di-f-ficult  to  get  an  appointment  with  most  clinics. 

50.  There  must  be  a  better  appointment  s/stem! 

51.  Getting  appointments  takes  too  long. 

52.  Too  long  to  wait  -for  doctors  appointments. 

53.  I-f  you  are  not  -fortunate  enough  to  belong  to  Family  Practice  it  is  too  tii-f-ficult 
-for  dependents  to  get  an  appointment. 

54.  Getting  appointments  is  most  -frustrating. 

55.  One  o-f  the  biggest  reasons  we  don't  use  the  -facility  is  the  wait  to  get  an 
appointment. 

56.  I  am  not  delighted  with  the  telephone  system  used  for  making  appoi ncments. 

57.  It  is  very  difficult  to  know  what  part  of  the  month  to  call  for  an  appointment. 
Also,  unless  you  call  for  an  appointment  using  a  direct  appointment  pnone  in  the 
clinic  it  is  impossible  to  get  through. 

53.  The  central  appointment  phone  system  is  terrible'  At  least  five  times  in  the  past 
seven  months  my  family  and  I  have  had  to  make  an  appointment  just  to  call  to  make  the 
actual  appointment  with  the  appropriate  clinic.  The  aopointment  pecpie  should  be 
fired!  The  system  is  very  frustrating  and  discouraging. 

59.  We  live  in  Canon  City  and  waiting  <on  hold)  for  central  appointments  to  answer  is 
a  toll  call.  At  the  last  base  they  had  an  appointment  cancellation  number  that  long 
distance  could  call  so  they  didn’t  have  to  wait. 

60.  The  appointment  system  needs  to  be  looked  at.  When  my  wife  has  neeaed  urgent 
appointments,  its  either  in  10  minutes  or  10  days  -  10  minutes  is  not  a  player  given 
our  off-base  residence. 


61.  In  my  12  years  in  the  service,  I  have  never  seen  an  appointment  system  that  didn't 
cause  considerable  delay  to  tne  person  trying  to  phone  in.  The  Academy  Hospital  is 
among  the  worst,  (including  Ellsworth  AFB,  Wr i ght-Patterson  AFB,  Vandenberg  AFB  and 
Peterson  AFB).  I'm  truly  skeptical  that  this  survey  will  have  a  si  gn: -f  i  cant  impact. 

62.  The  appointment  method  needs  help.  There  are  times  it  takes  me  40  minutes  o-f 
constant  dialing  to  get  tne  appointment  desk  and  there  is  no  guarantee  o-f  an 
appointment . 

PEP I CAL  RECORDS 

6-3.  Twice  during  the  past  couple  o-f  months  when  coming  in  for  an  appointment,  my 
medical  records  have  not  been  at  the  proper  clinic.  Thus  I  was  sent  around  to  the 
clinics  searching  for  them,  wasting  my  time  and  delaying  my  seeing  the  doctor  at  the 
scheduled  time. 

64.  The  records  section  sometimes  keeps  people  waiting  unnecessarily.  I  think  they 
seem  to  have  their  youngest,  most  inexperienced  airmen  on  the  front  desk.  I  sometimes 
have  had  to  wait  numerous  times  because  someone  in  front  of  me  had  a  problem  that  was 
not  routine.  The  airman  handling  tne  situation  often  lacked  the  expertise  to  handle 
the  problem  quickly. 

65.  Our  medical  records  have  disappeared  for  weeks  on  end  and  after  many  phone  calls 
and  inconvenience  they  are  suddenly  found. 

66.  The  hospital  needs  a  different  way  of  handling  laboratory  and  X-ray  reports.  They 
loose  half  of  them. 

67.  Since  the  Family  Practice  Clinic  moved  it  has  become  difficult  to  obtain  records 
especially  when  you  are  elderly  or  have  a  sick  child,  you  must  walk  back  and  forth  to 
get  the  chart. 

68.  Records  are  not  always  available  at  the  Family  Practice  Clinic  for  scheduled 
appointments. 

PETERSON  CLINIC 

t.9.  I  am  normally  seen  at  the  Peterson  AFB  Clinic.  Their  system  for  appointments  is  a 
disaster  and  the  whole  place  should  be  discontinued. 

70.  Additional  personnel  and  facilities  have  to  be  provided  at  Peterson  Field  so 
people  don't  have  to  travel  all  the  way  to  the  Air  Force  Academy. 


APPENDIX  Y 
IMPLEMENTATION  PLAN 
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PILOT  TEST  EVALUATION  PLAN 
(60-Day  Test) 


This  is  the  evaluation  plan  for  the  60-day  pilot  test  of  a 
decentralized  appointment  system  hub  established  in  the  Internal 
Medicine/Neurology  clinic.  This  pilot  test  began  on  20  June 
1988.  The  post-test  evaluation  consists  of  four  main 
components : 

1.  Clinic  health  care  provider  productivity:  comparing  the 
HCP  productivity  prior  to  the  test  period,  with  productivity 
during  the  test  period.  This  will  be  monitored  by  Resource 
Management  (SGM),  and  the  Chief  of  Hospital  Services  (SGH). 

2.  Clinic  and  CAS  staff  satisfaction:  this  will  be 
measured  using  the  questionnaire  shown  in  attachment  one. 

3.  Clinic  patient  satisfaction:  this  will  be  measured 
using  the  questionnaire  shown  in  attachment  two. 

4.  CAS  patient  satisfaction:  this  will  be  measured  using 
the  questionnaire  shown  in  attachment  three. 

This  evaluation  plan  was  agreed  upon  by  all  personnel  involved 
with  this  test.  It  was  also  briefed  to  the  Hospital  Commander, 
and  approved  by  the  hospital  Executive  Committee. 


3  Attachments 

1  Staff  Satisfaction  Questionnaire 

2  Clinic  Patient  Satisfaction  Questionnaire 

3  CAS  Patient  Satisfaction  Questionnaire 


staff  Interview  Survey  Questionnaire 


PURPOSE :  This  study  is  being  conducted  to  determine  how  you  feel 

about  the  system  used  for  making  outpatient  appointments  at  the 
USAF  Academy  Hospital.  It  should  take  you  approximately  5 
minutes  to  complete  this  survey.  The  results  of  this  survey  may 
have  a  significant  impact  on  future  pol icy/guidance  and 
configuration  of  the  appointment  system. 

All  answers  to  the  questions  should  be  based  on  your  experience 
with  the  appointment  system  at  the  USAF  Academy  Hospital  and  not 
any  other  experience  you  may  have  had  with  other  appointment 
systems.  Your  answers  will  be  combined  with  those  of  other  staff 
members,  and  presented  for  analysis  at  the  completion  of  the 
survey . 

Your  cooperation  in  completing  this  questionnaire  will  be  greatly 
appreciated  and  will  provide  valuable  information  which  may  be 
used  to  make  the  outpatient  appointment  system  serve  you  better. 

L  V-' 

LOWELL  A.  SCHUKNECHT,  JR.,  Col,  USAF,  MC 

Command  Surgeon/Hospi tai  Commander 


PLEASE  TURN  TO  THE  NEXT  PAGE  AND  FOLLOW  THE  INSTRUCTIONS  FOR 
COMPLETING  THE  QUESTIONNAIRE 


Atch  1 


PAGE  2 


1.  Plcftsc  place  an  'X‘  in  the  box  in  front  of  the  atatement  which  best  describes  your 
current  status: 

(  )  Physician 

(  )  Optoroetrist/Nutritionist/Audiologist 

(  )  Nurse  Clinician 

(  )  Clinic  NCOIC 

(  )  Appointment  Clerk/Supervisor 

(  )  Department  Manager  (Non-cl inical) 

(  )  Executive  Management 

(  )  Other  -  Please  Specify:  _ 


2.  How  long  have  you  been  in  your  present  position  at  the  USAF  Academy  Hospital? 

(  )  Less  than  6  months 

(  )  6  months  to  11  months 

(  )  1  to  3  years 

(  )  More  than  3  years 


3.  In  what  clinic  or  appointment  area  do 

(  )  Central  Appointments 

(  )  Surgery 

(  )  OB/Gyn 

(  )  Nutrition 

(  )  Neurology 

(  )  Dermatology 

(  )  Acute  Care 

(  )  Family  Practice 

(  )  Ortho/Podiatry 

(  )  Pediatrics 

(  )  Internal  Medicine 


you  serve  in  your  present  position? 

(  )  Nuclear  Medicine 

•  {  )  Ophthalmology 

{  )  Optometry 

{  )  Cardiopulmonary 

(  )  Mental  Health 

(  )  ENT 

(  )  Other  -  Please  Specify; 


(  )  Not  applicable  -  I  do  not 

work  in  a  clinic  or 
appointment  area 


PLEASE  TURN  TO  THE  NEXT  PAGE  AND  FOLLOW  THE  INSTRUCTIONS  FOR 
COMPLETING  THE  QUESTIONNAIRE 


Plosc  circle  the  number  which  best  describes  your  feelings  about  each  ol  the  following  issues 
related  to  the  way  in  which  the  appointment  system  operates.  High  numbers  indicate  satisfaction 
and  lower  numbers  indicate  dissatisfaction.  Please  consider  only  the  USAF  Academy  Hospital 
appointment  system  and  not  any  other  system  you  have  had  experience  with. 


Not 

Applicable 

N/A 

Very 

Satisfied 

Satisf led 

He i ther 
Satis  f ied/ 
Dissatisf led 

Dissatisf led 

Very 

Di ssa  1 1 s  f 1 ed 

4 .  Your  ability  to 
obtain  patient  and 
schedule  information 
from  the  appointment 
system'* 

N/A 

5 

4 

3 

2 

1 

5.  How  satisfied  are 
you  that  the  central 
appointment  clerk 
matches  the  patient 
with  the  proper 
appointment  slot? 

N/A 

5 

4 

3 

2 

1 

6.  How  satisfied  are 
you  with  your  ability 
to  contact  the 
central  appointment 
clerk  when  you  need 
to? 

N/A 

S 

4 

3  . 

2 

1 

7.  How  satisfied  are 
you  with  the  number 
of  appointment 
scheduling  people 
in  your  area? 

N/A 

5 

4 

3 

2 

1 

8 .  How  satisf ied 
would  you  be  if  all 
appointments  were 
made  in  the  clinic 
area  (given  no 
additional  staffing)'* 

N/A 

5 

4 

3 

2 

1 

9.  Your  overall 

N/A 

5 

4 

3 

2 

1 

opinion  of  the 
appointment  system 
used  to  make 
appointments'* 


PLEASE  TURN  TO  THE  NEXT  PAGE  AND  COMPLETE  THE  QUESTIONNAIRE 


PAGE  4 


10.  If  you  could  change  anything  about  the  appointment  system,  what 
would  it  be? 


11.  How  would  one  additional  full-time  appointment  clerk 
patient  care  provided  in  your  area? 


affect 


the 


AFTER  COMPLETING  THIS  PAGE  PLEASE  RETURN  THE  SURVEY  TO  MAJOR  SHIELDS 


*  » 

*  THANK  YOU  VERY  MUCH  FOR  YOUR  TIME  * 

»  IN  COMPLETING  THIS  SURVEY  * 

tt  » 


INTERNAL  HEDIC INEZ NEUROLOGY  CLINIC 
OUTRATIENT  QUESTIONNAIRE 

PURPOSE;  This  study  is  being  conducted  to  determine  how  you  +eel  about  the  system 
used  •for  making  outpatient  appointments  at  the  USAF  Academy  Hospital  Internal 
Medicine/Neurology  Clinic.  It  should  take  you  approximately  3  minutes  to  complete 
this  survey.  The  results  will  be  used  to  give  you  the  best  appointment  system 
possible. 

Please  place  an  "X”  in  the  spot  that  best  indicates  your  answer. 


1.  In  what  clinic  were  you  seen? 

(  >  Internal  Medicine  (  )  Neurology 

(  )  Other  -  Please  speci'fy: _ 


2.  Did  you  have  an  appointment?  (  )  Yes  (  >  No 


3.  What  is  your  bene-ficiary  category? 

(  1  Active  Duty 

(  )  Dependent  o-f  Active  Duty 

(  )  Other  -  Please  speci-fy: 


(  )  Retiree 

(  )  Dependent  o-f  retiree  or 

deceased  member 


PLEASE  TURN  TO  THE  NEXT  PAGE  AND 
COMPLETE  THE  QUESTIONNAIRE 


I 


PAGE  2 


Please  circle  the  number  which  best  describes  your  -feelings  about  each  oi  the  -following 
i ssues. 


Not  Neither 

Applicable  Very  Satisfied/  Very 

N/A  Satisfied  Satisfied  Dissatisfied  Dissatisfied  Dissatisfied 

4.  Your  ability  N/A  543  -  ^ 

to  contact  the 
appointment  clerk 
when  you  need  to? 


5.  Were  appointment  N/A  5 

personnel  courteous 
and  helpful? 


6.  Your  overall  N/A  5  4 

opinion  of  the 

Clinic  Appointment 

System  used  to 

make  your 

appointment. 


Other  Comments 


AFTER  COMPLETING  THIS  PAGE  PLEASE  RETURN  THE  SURVEY  TO  THE  CLINIC 
TECHNICIAN.  IF  YOU  PREFER  TO  MAIL  THE  SURVEY,  PLEASE  SEND  IT  TO: 

USAF  ACADEMY  HOSPITAL/SGHM 
USAF  ACADEMY,  CO  80840-5300 


*  THANK  YOU  VERY  MUCH  FOR  YOUR  TIME  ♦ 

♦  IN  COMPLETING  THIS  SURVEY  ♦ 


DSAF  ACADDfT  B05PITAL 
OmTATIEirT  QOESnOllRAXKZ 

The  USAF  Acadeny  Hospital  personnel  want  to  give  you  the  best  medical  care  possible. 
To  ensure  we  are  providing  quality  care,  we  Invite  your  comments.  Please  take  a  few 
minutes  to  give  us  your  honest  opinion  of  the  medical  care  ana  service  you  received. 
Recognltlcr  of  good  employees  helps  ensure  continued  top  performance,  so  please 
Identify  iudlvlduals  (physicians,  nurses,  medical  and  administrative  technicians, 
etc.)  by  name  whenever  possible.  Please  comment  on  "No"  answers  at  the  end  of  this 
questionnaire. 


CLINIC  IRFOKMATION 


A. 

In  what  clinic  were  you  seen? 

• 

B. 

Did 

you  have  an  appointment? 

_ ^Yes 

_ No 

C. 

Who 

was  your  health  care  provider? 

a 

D. 

Were 

you  seen  at  your  scheduled  appointment  time? 

Yes 

No 

E. 

Were 

all  clinic  personnel  courteous  and  helpful? 

Yes 

No 

APPOnrTMPfT  STSTPf  nPOMATIOII 

Yes  No 

F,  Were  you  able  to  make  an  appointment  without  difficulty?  _  _ 

G,  Did  you  use  the  central  appointments  system?  _ 

H,  Were  central  appointments  personnel  courteous  and  helpful?  _ 


OPTFATinff  KEOOBDS  HffOlWATIOW 

Yes  No 

I,  Were  your  records  available  In  the  clinic?  _  _ 

J.  Did  you  handcarry  your  records?  _ 

R.  If  you  visited  the  outpatient  records  desk,  were  the  technicians 

prompt  and  courteous? 


AHCILLART  SE3L7ICZ  IRFOUIATIOII 
(Laboratory,  Pharmacy,  Radiology) 

L.  How  long  did  you  have  to  wait  for  service:  0-30  min  30-60  over  60  Not  used 

Laboratory  _  _  _ 

Pharmacy 

Radiology  (X-ray)  _  _  _  _ 

M.  Were  ancillary  personnel  courteous  and  helpful? 

Yes  No 

’ Labors  tory  personnel  _ 

Pharmacy  personnel  ~  ' 

Radiology  personnel 


(continued  on  reverse) 


USAFA  Form  0-566,  MAY  87  (sgr) 


Atch  3 


PATiDrr  TRsnocnoiis  axd  pofixov-up 


Yes  No 

N.  Were  you  given  nedlcatlon(8)?  _  _ 

O.  Were  you  given  Instructions  on  the  use  of  medics tlonCs )?  _  _ 

P.  Were  you  given  Instructions  on  follow-up  care?  _  _ 

Q.  Were  questions  regarding  your  medical  condition  and  treatment 

answered  to  your  satisfaction?  _ 


INFCntMATION  ABOUT  YOU 

_ (Optional) _ 

NAME/RANK  SEX;  Male  Female 


AGE  GROUP:  _ Under  18  _ 18-30  _ 31-40  _ ^41-50  _ Over  50 

STATUS:  _ ^Active  Duty  _ Cadet  _ Cadet  Candidate  _ Retired  _ Civilian 

Dependent  of  Active  Duty  Dependent  of  Retired/Deceased 

ADDRESS/OFFICE  SYMBOL:  _ 

HOME  PHONE;  WORK  PHONE: 


cxiwwMnrs 

(Please  eoassent  on  all  ‘‘Ho**  aaaeers) 


Thank  you  for  completing  this  questionnaire.  Please  return  It  to  the  Outpatient 
Records  Desk  or  the  Patient  Affairs  Office  before  you  leave  the  hospital.  If  you 
care  to  mall  the  questionnaire,  please  send  It  to:  USAFA  Hosp/SGR,  USAFA,  00 
80840-5300. 


USAFA  FORM  0-566  (Reverse).  MAY  87 
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